That's true only if the SSPX priest doing the sermons is a modernist and that going to his chapel is objectively a danger to the faith.
By associating with the SSPX the priest is declaring his agreement.
Why should we be expected to drill down each and every priest.
Another lunatic position like your obsession with Thuc and sedevacantism.