It is easy to judge the whole based on experiences with the few.
Since the Order has sinners in every level, you may expect to encounter sin, brokenness, error, etc. whenever you attend a KofC function.
The reasons for the Order's existence are laudatory, and their work on behalf of the Pope, the needy, and the unborn are exemplary.
I advise, as your brother in Christ, and as a Knight, that you pray about it, do whatever due diligence you decide is best, and then make your decision, as you would do for any other activity that takes up your time and which you are having questions/concerns about.
I ask you do not, however, hastily and broadly put the order down because of your experiences, for there are many good men in it who are sincerely working out their salvation and trying to serve God and fellow men, and they could use all the help they can get.
Pray for us, as we are sinners in need of Grace.