I agree. It is a needless risk. You're much better off just flying a published approach.
I can imagine situations where a contact approach would allow you to stay out of icing.
I have used the contact approach in situations when it was safer than flying the published.
It is just another tool at our disposal.
I have used a contact approach once, and once only; and it was under circumstances in which it was by far the best choice for me.
We were flying into Pensacola from the West, in and out of clouds with some rain, but nothing terribly severe for us. There was, however, a solid line of very heavy rain moving in, and (at the same time) a conga line of Navy trainees inbound.
As I was being vectored for the approach, for which I was probably going to be number three or number four, we over flu the bay adjacent to the airport, with all-terrain in the vicinity of the airport readily visible; continued vectoring, however, was going to take me right into the very heavy wall of water we could see a mile or so ahead of us.
When I said "Niner Two Romeo requests a contact approach…", Approach could not have been quicker to immediately respond, "Niner two Romeo cleared for the contact approach, contact tower…"
I was instantaneously cleared the land, and was on the ground in, perhaps, two minutes, and managed to get most of the bags unloaded before the heavy rain hit, while the trainers were slogging it through the heavy weather, one by one. I was, on that day, very glad that my instructor had discussed the contact approach with me at some length. He had told me, "you may never need it, but you'll be glad to have it if you do." He was right.