Just keep going as normal, it is too late now and deal with any issues after harvest.
Seeds take 4-5 weeks to mature so any new pollination won't have any time to get seeds of any real size, the ones that are already there, just pick them out after harvest.
Male flowers can be hard to find, but there must have been at least one mature one, somewhere, at some time, if you are finding some seeds now.
Also, don't try growing any mature seeds you find, hermaphrodites tend to breed hermaphrodite dominant seeds.