If you only smoke once or twice a week, then it should be easy to hide it (if that's what you wish).
I think that smoking from a pipe is a very different beast to cigarette smoking, but we can't know the ways in which we'll influence our children. No one here is qualified to tell you how to raise your children, but if you have misgivings then raise them to your priest and your spouse.