Yes, we can all speculate - e.g, your "it's likely . . . " For example, St. Robert Bellarmine was of the opinion that St. Augustine did not hold that the infants were burned.
That is why I want to consider what he actually said and thought, as he himself expressed it.
We know that infants were in the place of fire and they suffered. Rest doesn't really matter and is a waste of time to argue. Whether this suffering was due to their proximity to the fire or simply some internal cause is unknown, but the essential point that this is a distraction from is that Augustine said they went to hell, the place of fire, "with the devil" and that they suffered.
Limbo is probably in the same category as BoD, no? Just like BoD, there's no evidence that it has been revealed, and there's no evidence for it, and you have some Fathers like St. Augustine who rejected the notion, though it seems to be present to some extent in the Greek Fathers. Just like BoD, after Trent and St. Robert Bellarmine, the notion that infants go to hell was almost universally abandoned, and nearly all theologians taught it for the past several hundred years (which the Catholic Encyclopedia article points out).
So why is it OK for you to reject Limbo but not OK for us to reject BoD? Both Limbo and BoD are in the same category o theological speculation.