How would you feel in this situation?

My family and I were at a nice little restaurant in Tennessee just a few hours ago. I've known the owner for about 14yrs, so he gave us a table in the back corner with plenty of room. An older couple came in and took the table directly opposite us. The whole time we were there these folks would give me the nastiest looks you could imagine and whisper for a moment before returning to their normal conversation. I'm guessing they didn't like my long hair and "Mess With the Best, Die Like the Rest" T-shirt. When the owner came back to our table he spoke to the couple. The older fella is the pastor of his church. When Frank (the owner) asked if I needed help getting up so as not to hurt my back, the pastor and his wife made a point of looking at the wall untill we left. On the way out the door, I heard Frank saying "If it wasn't for that boy, you wouldn't have your nice church. He built it!" I'd never heard him speak harshly to anyone before, but he sounded angry. It bothered me to hear it.