Being based in the Austin area, I can tell you we have a constant battle with ATC. We've even had meetings with some of them, but it doesn't change anything. When I call them, they vector me for no reason, when I don't they complain.
One day I was flying outside of their airspace, pretty close to it, but at 4500' (elevation is 541'). I was listening to approach and got a call, "N2743G, are you on frequency". At this point, I'd already heard him chew out three other pilots for not talking to him and being near his airspace, including one that was about 1000' over his airspace, so I knew when I responded it would get interesting. He told me if I was going to "putt" around near his airspace (I was flying in a straight line for over 50 miles), I needed to descend to 2500'. This made no sense because I was close to the approach end of the airspace and getting lower would put me closer to the airlines, but I simply replied, "Roger, N2743G". There were a lot of puffy clouds below me, so I started looking for a way down where I wouldn't get too close to the clouds or pick up too much speed. He called me again. "N2743G, did you understand my request? I'm having to vector Delta around to stay clear of you." I replied, "Yes, I understood it, I understand it's a request and I'm not in your airspace, so I'll comply when I can safely get down. Tell Delta to have fun flying circles, they're nowhere near me." I didn't get a response from him.
Because I've heard that attitude so many times from them, I will no longer respond when asked if I'm on the frequency.