Worms are a no go...

[LilyPad]

I figured it would be okay, I was worried about them dying and rotting and what that would cause, but if that's fine, I'm okay with it!! I will be switching vivs in a few weeks anyways (hopefully)

[John]

Tree frogs rarely encounter earthworms so they don't generally eat them. This is pretty normal. Desert toads and toads from hot arid places in the southern US have the same problem - they never encounter earthworms and either don't eat them or have a hard time trying to deal with them.

[artes]

If they rot, that just means more biological activity in your soil.

Edit:
My college degree -might- have been in soils. Cough.