Many here will disagree, but one step at a time. The fact your husband is willing, has to be seen as a step in the right direction. Slip a green scapular under the seat of his car. And pray that Our Lady will convert him.

Tell him to read it in English and listen to the homily in English and tell him that Latin is the universal language of the church, and Christ spoke Latin with Pontius Pilate.  Your husband may be trying to dodge out of going to Mass, by saying what he is saying.  

Yes, he has refused to go to Mass for the past 5 years so now that he is willing to go, I don't know what to do.

My non Catholic husband has finally agreed on attending Mass with us. Thank God!

However, the problem is that he says it has to be in English. He does not want Latin!

Please help. What should I do?

He has not agreed to attend Mass.  For him to agree to attend the Mass only if it is in English is the same as if he agreed to attend an Anglican or other Protestant service.  The only thing liable to happen if you agree to attend the English service (which must be the Novus Ordo) is that you would stop attending Mass and would join him in attending a Protestant (and oftentimes outright Pagan) ceremony.

The only thing to do is to continue to pray, use the Green Scapular, and pray; but do not compromise on the Mass.