If ADSB was only about safety, they would allow us to have portable units you could move from plane to plane. There is no safety reason for you to see my N-number when flying, only where I am and which direction I'm traveling in. The N-number is so they can track you down. I know of two cases personally where the pilot got in trouble based on NTSB data. Someone reported my friend flying low over a house he was thinking of buying. They didn't have the N-number, but the FAA got it from ADSB data. Another was a guy who may have flying illegal substances. His ADSB would only come on when going into controlled airspace, then go off for the rest of the flight. They used this violation to catch him.
I like ADSB, but it's not just for our safety and I hope nobody thinks it is.