Doesn't matter what the critters are - thrips, spider mites, whatever - you need to get rid of them and fast... Grab some Spinosad or some Dr. Zymes Eliminator - both are organic and both will kill not only the adults but the eggs/larvae as well... just follow the directions!
Good luck!