Yes, they do look like Gray treefrogs- either Eastern or Cope's, whichever occurs in your area.