I think it's the sense of humour. As I recall, all the Tudor ladies had the same kind of dry, sarcastic wit. Which is why we liked each other so well. A lot of people just don't get it though. Not to mention, some people are put off by any humour more complex than fart jokes.

You're probably just smarter and better educated than them and it shows and it makes them uncomfortable. I wouldn't worry too much about it.