Check your plant thoroughly and often, paying particular attention to the underside of the leaves and remove them by hand when/if you find any.
Look for dried up small, black round poop as a clue that there may be a caterpillar on a leaf above the poop.
Far safer in my opinion, than spraying anything on a plant you intend smoking, no matter how "safe" any product claims to be.
Hope this helps, Organoman.