Never, only ever remove yellow leaves, for by the time they are yellow, they have served their purpose.
Your plants need every single healthy green leaf they have to make the energy they need to grow.
As you found out, removing leaves just causes the plant to grow new ones, wasting a lot of energy that could have gone into other growth. If you are dead keen on defoliating, doing so in veg is possible, but it should be avoided at all costs during flowering.
Just remember, -
Maximum amount of healthy green leaves = maximum energy production = maximum growth.