What I am concerned with is the leaves are turning yellow now and I feel the nugs are small. What is it that I did wrong or ladies on schedule

Fairly normal if you've cut out the majority of the nitrogen feed. However, I'd say your defoliated too much, hence the small buds but it could be anything so don't take my word for it.

The color of the leaves in the week you’re in should be normal. I suggest increasing the nutrient doses a bit (ideally measuring EC or TDS). The yellow ones will continue like this until they fall since the plant absorbs its energy to feed itself. From what I can see in the photo, the light is too high in relation to the distance. I recommend a distance of 30/50 CM from the tip for LED lights and gradually increasing it. These weeks should be the fattening of the flowers, so I suggest keeping an eye on the fattening fertilizers.