Limbo is the upper, upper part of hell, because the main punishment of hell is loss of God, which the ignorant lose. There is ZERO chance the ignorant go to heaven. There is ZERO chance anyone in heaven won’t see God.
OK, so here you completely trip yourself up. Those in Limbo are NOT PUNISHED, and those in Limbo HAVE NOT LOST GOD
simpliciter. They do not receive the Beatific Vision, which is a free gift of God, which our created nature can't begin to comprehend, as it's beyond the capacity of our nature, but in no way is deprivation of the Beatific Vision a punishment This is what St. Thomas articulated regarding Limbo, and it's also what Pope Pius IX was talking about in terms of how God will not permit those who have not committed actual sin to be punished. St. Gregory nαzιanzen, in those passage you should know quite well, since it's where he rejects Baptism of Desire, talks about how there are those who are not bad enough to be punished, but not good enough to be glorified, glorification being the elevation of our nature to where we can see God face to face.
Hell is where the enemies of God go, the reprobate, but the infants in Limbo are not reprobate, are not being punished, are perfectly happy, are not in any enmity with God, and they undoubtedly interract with the saints who are in fact able to behold the Beatific Vision, something which the damned would not and cannot do.
You're stuck in the very same binary mindset of how there's only Heaven (with the Beatific Vision) or else Hell (with punishments), and it's why St. Augustine concluded that infants who die without Baptism are punished ... although just a little bit, on account of their loss of God. St. Thomas helped overturn this binary thinking and articulated the distinction between the supernatural elevation of Heaven, and the natural reward vs. punishment.
So, unhappiness and suffering are the results of being deprived of a due good. But because human nature does not even have a capacity to see God face to face and enjoy the Beatific Vision, the simple lack of the Beatific Vision along cannot cause suffering. By way of analogy, a squirrel does not suffer because it lacks the capability of speech, and that's because it has no clue even what that is, and its nature was not designed in such a way that the squirrel's perfection requires the faculty of speech, and therefore the lack of something that it hasn't even got the capacity for cannot cause suffering.