I buy the reverse osmosis water from the store, because my tap water not only is fluoridated but has all kinds of harmful additives in it. I would not drink it unless there were nothing else to drink.
Drinking straight tap water is disgusting and unhealthy, with most of the municipalities adding all kinds of detergents and "fluoride" to the water.