Cotton cloth okay?

Is a cotton cloth okay for wiping down the glass walls of a frog tank?

Yeppers. As long as you are just using it to wipe down the glass. Actually, you can use pretty much anything for that task. :)