OP, I suggest you read Castii Connubii, which is quite possibly the best compendium of the Church's teachings on marriage. A must read for all married couples. You will find that it addresses your issue. I'd quote it for you, but then you wouldn't have a reason to read it, and it sounds like you should.
It's a bit long, so it might take you some time. You don't have to do it all in one sitting. But read it.