You should cut off the parts with mold, very carefully. If you can't control the spread, then yes, harvest. Take all the parts with mold to a separate room so you don't spread spores. Then cut off the affected parts and dry the ones that had mold separately.