I wouldn't take anything off unless I had to, airflow etc. But if you have to defol then uncover the bud sites and take a load of that lower stuff off, at least you'll have good flow, but if you don't need to do it then I wouldn't bother
Exactly what the other guy said, if your gonna pull of any only the ones blocking bud sites or the ones in the centre of the plant to increase airflow.