If a couple found out they were sterile, then relations would be a venial sin every time, since conception can't take place, right? Of course not.
There are various theological viewpoints, but what matters is the final decision of the Church. There were theologians who thought Our Lady wasn't immaculately conceived but they were wrong.