Yeah you can use bleach, just use a very small amount diluted in water and then rinse it out really well after it. Let it sit out so all the fumes dissipate before you put in new frogs.