You have touched on a real landmine for Catholics in the 21st century. Namely, HOME ALONE-ISM.
There are various reasons which cause Catholics to stay home on Sundays, aloof from the Mass and the Sacraments. The devil wants this very badly -- he'll get us any way he can.
One way: those who are Sedevacantist, and who come to believe that attending Mass said by a non-Sedevacantist priest is sinful or odious to God. So they stay home on Sundays.
Another type is those you describe: who believe the whole Traditional movement is not legitimate. Often these Home Aloners dislike the Novus Ordo just as much, but they still stay aloof from Tradition and don't partake of Mass and the Sacraments.
There are many paths to keeping the Faith during this Crisis in the Church. Each offers advantages and disadvantages. However, the path you speak of offers NO advantages. It's probably the devil's favorite. And it's so dangerous, I won't even allow proponents of it to post here on CathInfo. It's that bad.
Those clinging to Authority (Indult, Novus Ordo, etc.) at least have obedience and authority.
Those clinging to Doctrine (Sedevacantists, recognize and resist, pretty much any Traditional Catholic) have the safety that unchanging Doctrine provides -- and God does not change.
Those rejecting the Novus Ordo, but still staying aloof from the world of Tradition have left themselves with NOTHING.
I wouldn't bet my soul that the current Pope is a legitimate Pope.
I also wouldn't bet my soul that he is NOT a legitimate Pope.
I just DON'T KNOW with anything resembling certainty. And neither do any of you! Anyone who claims otherwise is simplistic, simple minded, and/or he has a shallow grasp of the facts and the situation.
I don't have the certainty of Faith either way. That's the point. So I'm not obligated to become a sedevacantist, OR join up with a group approved by Rome.
What I *am* obligated to do is extricate myself from the danger: namely, the Novus Ordo Mass and the Modernism that surrounds it. The fruits are clear: it is from Freemasonry, not from God. It destroys 95% of souls that it touches. We have 45 years of proof.
Enter the Traditional movement.
What we DO know with the certainty of Faith: that God wants us to save our souls. And that the Mass and Sacraments are the means God Himself chose to give grace. And that the time we are to live is RIGHT NOW, where God placed us.
We have to LIVE and keep our Catholic Faith. The Crisis has gone on for almost 50 years now. If the home-aloners you speak of were correct, then I wouldn't have been raised Catholic at all! Sure, my parents might have said some prayers with me, taught me a Catechism, or taught me how to make a spiritual communion. But it wouldn't have been the same. Instead, they raised me in one of the many TRADITIONAL CATHOLIC lifeboats, and the fruits are plain to see.
They may not be ideal, they may have flawed individuals, and you still have to be prudent and careful (there are predators -- con men -- wolves -- weirdos -- etc.) but the good FAR OUTWEIGHS the bad.