yes you could, but in my experience, waterheaters are pretty intense. If you take them out of water for about 20 seconds, they will burn themselves up, they get SO hot.

So I would find a way to keep the frog away from the heater, such as stack bricks around it or something.