An ultra violet light (the kind labeled "tropical" rather than "desert") would be good as long as it doesn't overheat the tank. There's a study that suggests it helps with a developing milk frog's bone density.
The rolling around on his back is a really bad sign. Either he's very sick, he has some kind of inner ear problem, seizures, or muscle problems. If he's jumping around and taking food from your hands he doesn't seem that sick. But still, be on the lookout for poor appetite, excessive soaking or not moving as signs of problems.
It would be a good idea to get some kind of calcium supplement to dust his insects with, on the off chance he has a calcium deficiency. That can cause muscle problems. Otherwise, it could be seizures, either from birth or from an accident. Not much you can do for that if that's the case.
I'd just keep the tank covered for a while, try to avoid loud noises near him and let him relax a bit. If he's wild-caught he might be more nervous than a captive bred frog.