Even without ADS-B on board, in certain areas to include the East Texas boon docks where I fly most, I can see I identified aircraft on my fish finder. If you are seen squawking VFR by radar, it is indicated on my fish finder as an unidentified aircraft. If you are on flight following, you will be identified by tail number also.
Although it is only a microscopic amount of safety level involved, IMHO removing an operational transponder is making you less electronically visible.
If the Xponder is operational, even if not tested, I am struggling to figure out what advantage there would be in removing it
When flying around directly above our little airport for several hours a few years ago owing engine break in, I spent lots of time just observing aircraft both with the naked eye and on the fish finder. I was surprised then when I learned that aircraft without ADS-B installed were showing up on the fish finder. I know many people at our airport and knew who did and did not have it. I even confirmed a few of them by asking them.
The effectiveness of ADS-B is debated constantly. I suppose that a similar debate could be had regarding Xponders, but why remove a working transponder?