I've lost two toads from not eating. I didn't take them out to eat much, and they died from starvation. I don't know how long you personally would want to wait but you may end up needing to take him to the vet. Just see how things go and do what you think is best.