as long as light hits that lower / larger one, i'd leave it.. or if it detoriorates for other reasons etc... a long as it's providing ATP, i'd leave it. That's what powers cellular growth / division / everything. Sometimes i remove a lower leaf jus for easier watering access.
the cotyledons can be removed wihtout much fear for sure at this point.