I remove any dead crickets that I find because they normally carry diseases that can infect healthy, living crickets. Not removing dead crickets would consequently result in a drastic decline to your cricket population.