Well the danger in flowering is that water can get inside the flowers and the mold risks grow exponentially. If you have bugs issues, at this stage I would use Rhino Skin and manual cleaning, but if it's serious you should consider something more powerful like a homemade brew with garlic, tobacco and cinnamon. Neem works, in my experience, more as a preventive solution than a cure.