It can cause trouble, depends on how strong the genetics of the plant are.
Some herm easily and a little light leak could be enough to get them to throw out a few bananas, but often it's not enough, so just keep an eye on them for anything that looks like a male flower or banana in the bud if she's further into flowering.