I've always been of the attitude that if it's fun it's fun. Never really concerned myself with what others think. I guess it's not a whole lot different than any other recreational activity like playing golf or fishing..if it's relaxing and takes one's mind off of daily B.S. then it's a good thing IMO..
I've also been known to fire up the trusty 'ole XXL on lunch breaks. We have a park not too far from my work where I've roosted some dirt a time or two over the years.