My advice is to only remove yellow leaves. Each healthy green leaf is producing energy, energy your plants needs to grow her flowers.
Less green healthy leaves = less energy produced = less/smaller flowers. It is that simple.
Try a bit of gentle "lollipopping" if you are overly concerned with the smaller inner flowers, but try to leave any healthy green leaves, even the lower ones in shade.
Autos really don't like being messed with. Hope this helps....
Organoman.