Unless you believe, as I do, that no usurper was actually ever elected.
I do believe that no usurper was ever elected.
Siri, IMO, was elected and uncanonically deposed by the conspirators. Some day the full truth will come out.
But there is no basis, it is nothing more than, as you say, an opinion-become-belief, an opinion founded upon an entirely unsubstantiated event, which was denied by Siri himself.
If however, Siri was actually elected and deposed (there is no method within the Church at all to depose a pope, canonical or uncanonical), Siri himself would in fact be guilty of at least a grave sin of omission by his denial or silence in the matter, which under those terms, he would be guilty of doing what sedes (wrongfully) say popes cannot do - sinning via the breaking the Church's "universal law" (which it really isn't) of papal elections, thus ipso facto he vacates the office anyway. So why believe in that conspiracy theory?