They will generally clean themselves off if it is bothering them. Putting down leaf litter or covering the substrate with live moss or other ground cover can help keep your frogs clean. What kind of substrate are you using?