I agree in general that the account of Adam and Eve given in Genesis doesn't quite add up, but I think that's just because it doesn't really tell us all the details of the story that would make it comprehensible in a fuller context. For example, it doesn't tell us all that much about why they ate the forbidden fruit, especially in Adam's case. He just says his wife gave it to him to eat, and he ate it. But it doesn't actually give us the reason why Adam ate it, or whether his excuse is accurate, which wasn't much of an excuse to begin with.
There are a lot of things about the Garden of Eden and these events that I would love to know, but I think we'll have to wait till the Last Judgment to really know and understand exactly what went down in that garden.