Honestly, I would just harvest and throw out whatever portions of mold are taken up, like the whole branch. The rest of the bud might be alright to toke, but I bet it turns out to be a harsh heavy type of smoke, not really worth smoking the micro-spores that are likely on the rest of the plant already.