There is a chemical thats produced naturally in them called Thiaminase.

"Goldfish carry the chemical thiaminase, so if goldfish are fed to other animals as Feeder Fish, then that carnivore may develop a serious vitamin B1 deficiency."

This quote was taken from this wiki page, http://theaquariumwiki.com/Goldfish The More You Know.