Sorry for your loss.

Perlite is inert and non toxic but it is an impaction risk as mentioned and should be taken out. Anything in the cage that's small enough to be swallowed needs to be small enough or soft enough to easily pass through the frog.