You won't get more seeds because of it, but pulling them off now won't benefit you either, you just risk unnecessary damage. Let them go and hope that it was only a little pollen. Worst case, you end up with some meh buds and a bunch of decent seeds for your next grow.
I would definitely give your plants a close inspection though. You may have a hermie, in which case you can sometimes remove the male bits to prevent further pollination. The good news is that your seeds will likely be feminized if that's the case!