I would suggest putting live blackworms in there. Blackworms tend to hide in plants and rocks, with one end sticking out. They live a long time, and your frogs will learn to hunt for them.
Blackworms are available at almost any fish store that deals in live food.