Those are open pollen sacs, so a bit more concerning than just lone nanners. They are open and yellow, so it was mature enough to be releasing pollen before you found them.
Only white pistils are receptive to pollen. The rust-colored ones are 'dead' as far as germinating pollen is concerned. You'll probably get a few seeds because those scas were open and mature before you caught them, but i wouldn't expect too much. But, buds from around that area may have some tiny seeds after just a week or two of development.. even if you don't notice with your eyes, it'll sure make smoke taste like shit, lol. if it happens late enough into flower, can't even pollinate it if pistils are all rusty. so, no need for doom and gloom. wait and see... if it has seeds make bubble hash.
plucking probably would have been sufficient, because any damage is already done. Always a chance the pollen produced was inviable too. It is localized negative effects, so only areas that are pollinated would suffer.