Just remember...........
Less leaves = less energy being made = less potential growth.
Flowers are relying on the leaves to make the energy that they need to grow to their largest size.
Personally, I never defoliate outdoor plants, especially during flowering.
Better to ask questions first if you are unsure, rather than do something and then ask if it is ok.......you can't undo what is already done.