Quite likely yes, it does appear to be a "banana".
You can pull them off as you find them. Tweezers make good banana removal tools.
For some pictures of these and male pre-flowers/primordia, go to my diary "cannabis conundrums" and in week 7 you will find them.
This may help you to identify more clearly what your plant is doing and what to look out for.
Hope this helps,.........
Organoman.