Are you sure the ants are ants and not wingless fruitflies? A photo would be good. Ants are usually not a good thing to have in a terrarium. Slugs tend to eat plants so I don't like them in terrariums either, but they're not usually harmful to the frogs. The worm really depends on what kind of worm it is. Again, we need photos.