Hi, normally nothing can happen. Those are umbrella fungi and it's more common than you think; they often appear in potting soil and are already present when you buy it. Don't worry if there aren't too many; nothing will happen.
You can remove them, and if there are too many, you need to let the soil dry out; mushrooms love it moist.
Good luck!