For me it all depends. My first, and still favorite, CFI (and I have nothing against the many wonderful CFIs I've studied with over the years, but my first was special) raised his voice for emphasis a number of times, though he was soft-spoken and courteous nearly all the time other than that. His "yelling" did startle me when it happened, and it had the desired effect: I sat up and took notice that I was doing something that could get me killed and I had better correct my technique. That's a valuable, and important kind of "yelling" that I don't consider unprofessional in the least.
The difference here is that the OP reports actually being AFRAID OF HIS CFI. That sounds like a relationship that's gone off the rails and if the OP can't confront the CFI and get a change in behavior, then I agree that the only fix is to find a different instructor. There is just nothing good about being emotionally stressed out due to personal interactions every time you fly with a CFI. If it's to the point of shedding tears as the OP said, then it's even worse. This isn't a sustainable situation and the OP needs to do something about it.
OP, can you sit down and talk to the CFI? Let him know how you feel about his behavior? If you can, maybe you can salvage the relationship. If not, you need to find another instructor post haste, because you won't learn well or quickly if you're scared sh!&less of your CFI, and the experience will leave you with bad memories of what should be an exciting, if challenging and roller-coasterish time (no pun intended). If you don't have the time left to find a different CFI then you need to confront him now, if you can.
I really hope you are able to resolve this in a way that you are satisfied with. Good luck!