Many stories of aviation fatalities have started just like yours: important event to go to, planned to fly, weather was bad, didn't want to drive, figured they could make it, and killed their entire family. You definitely made the right call, even though it sucks.
My first instructor told me...