Oh, what frogs do you have? I would suggest that you change the water regularly and depending on the frogs will depend on how often.
Post a pic of your terrarium and frogs too since we all love pics :-)