You are not obliged to give to any special collection. When asked, simply decline politely, “I am unable to make a donation at this time.” You need not give any further information like, “May I ask why?”
“I do not discuss financial matters with anyone other than my husband and financial advisor.”
That should end the matter.