Refined sugar is a much better alternative (and much less processed) than high fructose corn syrup, which is in everything and which destroys your pancreas.
Plant oils, seed oils, fried foods, pesticides in produce, cereals, MSG, diet drinks, sugar alternatives and preservatives, — these things are far, FAR more damaging to the body than refined sugar.
At least sugar is a natural product, from the cane plant. It’s been somewhat processed to remove the nutrients but it’s still from nature. All the things listed above are chemical-based and will slowly kill you.