I too am very careful not to smoke where it may offend anyone....UNLESS it's specifically a smoking area. For example, last night we had drinks outside on a nice terrace with fire pits overlooking the ocean in Laguna Beach, California at the St. Regis. Smoking was allowed in this area, and they even brought me a very nice, large cigar ash tray.
Well, there were many other groups of people around, and NOBODY else was smoking. A couple groups of people (specifically the females in the groups) were very obvious in their disapproving looks, and they went inside. Nobody actually said a thing, but if they had, my reply would have been that this is the ONLY place I am allowed to smoke a cigar, but non-smokers like they can go anywhere else. In other words, I can't go anywhere else and smoke, but THEY are totally free to go anywhere else on the property. Bye-bye.