Springtails move much more quickly than mites- and they swarm around feces.
Sounds like you have springtails.