You should not be stressed at all, even if your leaves are full of them just prepare a spinosad solution or a neem oil + pure marseille soap solution, they'll be dead in 2/3 days but repeat the treatment at least once after 7 days. Also, if there are not a lot of them you can remove/kill them by hand (don't touch other plants while you do this) but i would do that only in late flowering stages. The MOST IMPORTANT thing is to NOT spray the buds, you are in mid flower so the buds shouldn't be that big and you shouldn't have any problem but remember that if you spray the buds it will probably affect the final flavour so be careful please and good luck with your grow :)
Oh, and remember to spray the back of your leaves too!