Wrong, your “duties” are to both God AND the pope. First to God and then to the pope who IS Gods representative on Earth. You have no right to flout any of his laws or disregard the obedience due to him unless he is asking you to do something that is MANIFESTLY sinful.
What Pope do you obey, then? If our duty is to God AND the Pope, then surely there is a Pope somewhere that you obey.