I've read about mushrooms randomly growing in vivariums before and have heard from a few people that they just leave them there.. I don't know if this is harmful to your frog though.

Do they look anything like this? Houseplant Care Guides: The Yellow Houseplant Mushroom...Eww!