All things conduce to the greater glory of God and our greater good, whether prosperous or adverse, even those things which often distract us.
St. Therese used to offer the distractions to God, or pretend they were music instead of annoying sounds produced by her fellow nuns.
Life is full of things which COULD prevent recollection, spiritual progress, sanctity, etc. They only WILL prevent such if we LET THEM DO SO. If we use accept them rightly, they will be the very source of our growth. It is up to us.