Yes I'm using clay cat litter for my backgrounds. I have read that if you use too much organic material in the clay, as it breaks down leaving small holes it will destabilize. I have no experience with this since mine have only been up for two to three months.

I don't let my clay dry out. I mist the walls everyday to keep them moist and I have algae, moss and other stuff growing in the walls now.