Those small "bananas" won't do anything much........just ignore them, make sure your lighting is correct again and continue as usual.
If you are really concerned, you can try and remove the bananas as they appear, but in reality, any pollen they release will be miniscule and it is too late to grow seeds of any size even if fertilization did occur.