East-West is no problem. I flew there all summer, every day, multiple times/day was cleared across midfield at 5000 (both ways). Only once in probably close to 200 flights did we have to go around.
North-South, on the other hand, I will agree with you 100%, never had to go outside the limits...