I don't see a problem in feeding any of your frogs any of the worms you've mentioned.

On the subject of earthworms, nightcrawlers is a common name for a species of earthworm. Red worms are also earthworms. The term "earthworm" describes a bunch of species commonly available in the pet trade, including the compost worms Dendrobaena/Eisenia which are the "red" or "wrigglers" sold by pet stores. This last group can produce distasteful fluid when stressed. It's not poisonous but it will deter most amphibians from eating them. Most amphibians get over this though if you don't give them alternatives, and they may even seem to grow to relish them.