Just remember, any leaves you remove will reduce your plants capacity to make energy, thereby slowing growth.
I only remove yellow leaves, for once they are yellow, they have served their purpose.
You could remove some of the paler lower leaves if you are dedicated to removing some foliage for whatever reason.
However, if your plant did not need those leaves, it would not have grown them in the first place!