By the water stinking, do you mean like a strong chlorine smell? Tap water filters de-mineralise most of the minerals commonly found in our water supplies that produce a smell or taste. If it smells really bad like yours though, it's a smart choice to go with your gut.
Spring water gallon jugs are fairly cheap so you probably don't mind the expense of feeling comfortable knowing that your herps have clean water. I understand and your welcome.