Different social groups have different sorts of "privilege".  Yes, to give the devil his due, a white dude probably can, for instance, take a solo road trip cross-country, stay in mom-and-pop motels, eat in small-town diners, go into gas stations, and so on, more easily and more comfortably than, let us say, a dark-skinned black woman could.  I will be the first one to say that she should be able to travel in that fashion --- if I were a night auditor, a waiter, or a gas station attendant, I'd help her any way I could, on an equal footing with anyone else, in fact, I'd be downright chivalrous, but not everyone is like that.  (Polishing the halo here...)

But this said, there are certain groups

* of whom no harsh word may ever be said
* whose motives may never be questioned
* whose excellence can never be called into doubt
* who can never be resisted or "have their hand called" even when their behavior is abrasive, rude, or antisocial
* whose intelligence can never be challenged (bearing in mind that intelligence is an individual thing)
* whose virtue cannot have doubt cast upon it (ditto)
* whose efforts can never be dismissed as futile

...and the list goes on.  I'll leave it to the intelligence of the reader to determine whether any of the above apply to any specific "Group X".