It took me 85.5 hours and 10 CFIs to get my private. I was frustrated. Some weren't great instructors, and I definitely wasn't a great student. But I kept plugging away until I had enough of the right bits to make it work.
It's that way with everything. Sometimes, for some people, it's easy. One of my CFIs got his ticket right at 35 hours. One of the other CFIs took 400 hours to get his COM.
Whatever it takes. There's no set right place to find the right CFI. That old guy with his own plane at a little airport might not give you any ground and might not have a lesson plan. But, he knows a ton and has a great price. Ok, then make your own lesson plan, and explain what you need. Maybe you find that one, young CFI at a busy school who has accepted he's stuck there for a while, and is very enthusiastic about training. He might be the one that explains all the ground stuff that you never knew you wanted.
Becoming a pilot is about taking charge of your own fate and making safe flight possible for you. Being overwhelmed, enraged, or giving up are all things that have to be redirected, controlled, and wiped away to truly be in control. Make note of what bothers you, and make sure you don't do the same thing. Build yourself into the best pilot possible. Always be critical of yourself.
Also, communicate individually with your CFIs. "It REALLY upsets me when you're late." or "I really need you to show once, then let me do it myself, then discuss and make corrections." Maybe it won't help. Maybe it will. Maybe it'll at least help you defuse yourself. Maybe you plan to show up 30 mins later than scheduled with that one CFI, or you have him show up 30 mins early.
Overall though, I recommend not giving up. There's a huge sense of pride that comes with getting your cert. You'll learn things that are unquantifiable that help you in other areas of your life. Find a way to make it work.
As for FSim, save it for your IFR practice. Rod Machado's narrative is good, but it's not interactive unless you've gone to fly with him as your CFI. Law of primacy comes into play, and you'll spend a lot of time untraining some little PPASEL things you got not quite right.