Removing leaves can cause excess stretch. the plant will try to reach for more light if it is not absorbing enough.
Don't remove leaves whimsically. HAve a good reason or don't do it at all. Fan leaves are not blocking new growth. you can bend them around if it bothers you.
last thing you want are gaps in canopy where light completely misses the plant. The products of photosynthese are highly mobile. Where light hits is motly irrelevant to growth pattern. Apical dominance will dictate allocation, not where the light hits.
if you don't over-crowd a canopy, you get proper airflow and light penetration without defoliation. You look fine in this regard... can tell you alrady took off too much.
Leaves are incredibly important anatomy. They do more than just absorb light. Your CO2 intake depends on leaf surface area, too... and co2 is far more of al imiting factor than any bro-science rationalization to remove leaves.
Keep as many leaves as possible. removing them is a huge negative that is unlikely to be overcome by some benefit that is most likely a figment of imagination to start.