Yes, since many of the tap waters are treated, leaving it sit out about 24 hours will get rid of many of the chemicals in the water, especially the chlorine used in the water systems of most municipalities.
About 24 hours with the cap off will suffice for this reason.
All the best. If you need followup, just hit reply. Please be sure to hit ACCEPT as that is the only way I receive credit for my help today.