The bottle plastic must have been exposed to heat or it aged naturally thru time (or too acidic water)

Try rinsing it with diluted vinegar and rinse with cold, tap. If it doesn't do the trick then get another one.