I've started to wait with cutting leaves that aren't in the way, till they're either completely yellow or dried up. So the plant gets a chance to use the nutrients from them somewhere else.
You can cut the tho. It won't hurt your plant. It might slow growth a little on the branches that sprouted from them compared to other branches. Depending on the size of the branches..