Unless the male flowers opened and released pollen, there can be no fertilization of seeds.
This is the price you pay for growing "bag seed", they are usually the result of hermie plants and hermie plants breed hermie seeds.
Hermies can also be a result of stress caused by massive defoliation, certainly something that has occurred to your plant as well.