Hi Gage,
Welcome to the forum
I feel the need to just say a couple things before I proceed with any advice, for any other potential new frog owners.
I know it's not your fault, but it's so important to do your research prior to bringing frogs into your home. A vivarium already set up and environment being monitored. This ensures there are very few problems when you do bring home your new pets.
With that being said, I think I can help you out.... You obviously care about your new pets and want the best for them, and that is great!

1. Read the care sheet for whites tree frog owners, if you haven't already
Frog Forum - White's Tree Frog Care - Litoria caerulea

2. Acquire a larger enclosure as soon as you can. Preferbly at least a 18x18x24 inch high one. Petco was having a sale last week on those for 79.99, actually not a bad deal. But also look at craigs list, classifieds, etc. A lot of folks sell theirs for fairly inexpensively. You can also research how to convert a fish aquarium to an upright viv. Sometimes you can find a 30 gallon long aquarium for pretty cheap that can be put on end. You would have to find an conversion kit....
For 2 white's tree frogs, I highly recomend at least a 29 gallon tank, I know it seems large, but they will thank you for it

3. As stated above, you need to treat your tap water. It is so important. Any of the de-chlorinators at the pet store in either the fish section or reptile section work fine. Never use untreated tap water, or distilled water. Change water dish to fresh water daily, while they are sleeping during the day.

4. Also as stated above, cover 3 sides of the tank to help them feel more secure, and get your temps up. At night they can withstand no lower than 65 F, but that is even a bit chilly. I keep my whites at about 74 at night and up to 83 during the day. You can get your temps up with a light during the day, and a heat pad on the side of the tank at night. No light at night, they like the darkness.

5. White's like to climb, so also provide vines and or plants, sticks, etc. Research how to properly clean them before placing in the tank.

6. Provide humidity between 60 and 80 percent.

7. 12 hour day and night cycle, get them on a predictable schedule. They need the routine.

8. Do not handle them. I never think it's ok to handle frogs, especially when they are acclimating to their new home.
I actually only handle my white's once per month to give them a check up. I check them for wounds or infections. I make it quick and gentle, then back in their home.

9. Keep them in a quite area, as mentioned above they are very stressed right now, and will continue to be easily stressed.

10. Feed only at night, try researching the glass bowl feeding method. It works great and is a wonderful way to monitor their food intake.

That's all I can think of for now....
Good luck, they're wonderful 'look, don't touch' animals... They are fascinating and can live for a long time with the proper care.

(sorry for all the mis-spelled words! I don't have spell check on this computer)