Your buds are looking really good so i would go with yes, defoliate. Remove anytging thats being a drain on the rest of the plant, large fan leaves, lower tiny popcorn buds, and any damaged leaves like you mentioned. Not only will your big colas flourish, but yes the lower amount of foliage should bring your humidity down. However i do see you're growing an auto and those typically have a little more resilience where mildew, mold and humidity in general are concerned...they just seem to handle abuses a little better in my opinion.
Happy Harvesting and great job with the grow...enjoy the trimming. 😊✌️