Based on what mentors of mine have told me. Defoliation is best in weeks 3 and 6 of flower. When in Veg you can trim them up anytime.
This might not be the most popular answer, but what I have went by on other grows and not experienced anything negative from it. Word of advice is not to remove all leaves but just those that are shading out other buds.