Heya Ashbuds!
At this point it is normal for some of the lower leaves to die off. They will fall off on their own when they depleted of energy. If I see leaves like this I usually give it a slight tug and if it doesn't fall off I will leave it.
Cheers,