There is more required than just wearing the scapular. It's not a lucky charm.
From the Ecclesiastical Dictionary 1900 page 631
"it is also necessary for all the members to observe the chastity proper to their state; virginal chastity in the state of celibacy; conjugal fidelity in the state of marriage; and continence in the state of widowhood.
Moreover, for such as can read: to recite daily the canonical Office of the Church, or the Little Office of the Blessed Virgin, according to Roman Breviary. etc."
It goes on to describe the fasts etc that must be followed by those who cannot read.
In the 1900's the popes have allowed for "great inconvenience" the substitution of the rosary for the Little Office WITH THE PERMISSION OF YOUR CONFESSOR
How many of us have sought that permission.