If there are fertilizers in the substrate, then yes, it would be toxic. Perlite if accidentally ingested can cause an intestinal obstruction.