The moss tends to stick to their skin so they end up eating it when they shed. So even if you are not feeding in the tank there is still a high risk of ingestion.
I don't think a little moss will hurt. I've never heard of a healthy frog getting sick over it.