It looks like your toad is pretty young. With amphibians, you can't really tell for sure what gender they are until they're grown up.

If you're going to keep the toad, there a few things you need to sort out..

1) You are going to need to buy a water de-chlorinating agent. You can get them pretty easily from the aquarium section at the pet store. Frogs and toads are very sensitive to chemicals and heavy metals in water, so unless you're using bottled spring water, you need to treat whatever water you provide for them with this de-chlorinating agent. This is very important.

2) Do you have a terrarium yet? If yes, be sure to cover the sides (at least three) with a dark (preferable green) material. Chances are the little guy is really freaked out, and covering the sides of the enclosure helps to reduce stress and make him feel more secure. Put some pebbles in the bottom of the terrarium, then cover with a couple of inches of Eco-Earth/Bed-a-Beast/coconut fibre substrate. Be sure to make the substrate nice and damp. Get some foliage or tunnels for him to hide amongst, and make sure he has a water pool/dish (de-chlorinated water)

3) Hold off handling him for a few days at least. As I said before, he's gonna be freaked out, and handling him's gonna freak him out even more. When amphibians are stressed, their appetite gets suppressed, so he may not eat until he's calmed down.

That's all I can help you with for now, I haven't dealt with toads before! Hopefully someone more experienced comes along, but that's the basics of what you need to do right now

Good luck

~Gabby

*EDIT* I have a suspicion your toadlet is a Fowler's Toad (Bufo fowleri)