can pluck them but they are in the soil for good now, High dose of P fertilizer will cause them to stop fruiting.
chances are they are this https://en.
wikipedia.org/wiki/Leucocoprinus_birnbaumii
Open caps are depositing more spores in the grow room and if there is any air movement they are going places.
Not the best idea to smoke the mushrooms or allow them to sporulate a lot in the grow room as they may land in the weed and its one less thing you need going on.
Good Luck!