I am intrigued by what you said because I see problems with both too.
Yes, I've struggled with this for years. Anyone who's honest in seeking the truth (and not just grinding an ax or going off emotion) has to see the real problems with both. But I finally came to the conclusion that I did NOT have to solve it. I do, however, need to come up with a Catholic position on the matter. I cannot embrace non-Catholic principles to justify being a Traditional Catholic. I see only two such viable positions: 1) subjecting myself to the Vatican II popes (and not just by way of lip service as Stubborn does, but in reality) or 2) sededoubtism (which I came up with).
This is similar to the position taken by Resistance Priest Fr. Francois Chazal ... and following the thinking in large part of the theologian John of St. Thomas.
Maybe I can start a thread about it sometime.