Depends.
If the male flower is mature and has opened and released pollen, yes you will find seeds everywhere.
If the male flower is closed and has not released any pollen, you won't find seeds anywhere.
If the plant in question has many male flowers growing on it, removing that plant may be the best option.
If the plant only has a very few male flowers, you may be able to remove them as they appear and this will stop all pollination, but you must not miss even just one male flower, as even just one male flower can release enough pollen to produce many, many, many seeds.
If your plants are not far from harvest, it may not be worth worrying about, as seeds take 2-3 weeks to grow to a noticeable/obseveable size and 4-6 weeks to get full sized and mature.
Remember too, seeds produced with hermaphrodite pollen will have dominant genes for being hermaphrodites themselves.
They will not be "feminized" and are virtually useless to grow or breed from, unless you are trying to develop a line of hermaphrodite plants!!
Hope this helps, Organoman.