It's hard to say why frogs turn brown. Sometimes it's heat or cold, sometimes not. In any case I wouldn't consider brown to be a necessarily bad thing. I suspect it might be like a human turning red because red and green makes brown.

I'd leave his hidey holes in place, though. Climbing isn't bad but frantic climbing might mean he feels stressed and wants out.