I think reptile bark may be ok, but I have never used it. I am sure someone else will sound off on it. The frogs will track the coconut shell into the water, that is for certain, I am not sure if it will clog the filter though.
Live moss may be the best substrate for a semi-aquatic set-up.