I get your point, and don't disagree, but from the controller's POV, 3,000 MSL is also an IFR altitude, so I can see why the controller would prefer you to not be at 3,000.
FWIW, I had a brain fart one day and flew ABI-CHK at 8,500, and FW Center never said a word.