Like John said it takes time.
My red spotted toad was wild caught and it took her 4 or 5 months to settle down. I never saw her eat when I first got her but now ill see her catch a few. And while she still doesn't really like being picked up, she'll now tolerate it to be moved when I clean her.
I kept my toad in the bedroom, that way she would see people come in and out and not hurt her, but it wasn't the most active room in the house.
The little guy just needs some adjusting time to get used to recognizing you as something that won't kill him.