Exactly. When I had an Aquarium, they recommended leaving the water to top off the tank uncovered for 24 hours to let the chlorine evaporate from the water.Chlorine outgasses pretty quick, sunlight or not.
We used to keep a couple of open half gallons of water sitting on the counter for drinking. A few hours and the chlorine taste was pretty much gone. Overnight, it was gone completely.