Goldfish are the dirtiest fish you could possibly keep in there, lol. I would take them out, but thats just me.....the goal with frogs is always to maintain the cleanest water possible and goldfish throw that off track pretty easily.