I agree, and this is why the Catholic church also teaches that we should never, ever try to judge the soul of a person who is dead.
Don't get me wrong, I believe in no salvation outside the Church, but I also believe that sometime it is hard to say who is exactly outside the Church after they have passed away. The key words are: after they have passed away.
Your souls is fixed at the hour of your death, it is fixed forever.