If you are at uncontrolled field, they MUST give you a void time on that release.
Believe me, this happens every time at my field where they've issued me a "hold for release" clearance and told me to call when #1. I tell them I'm standing at the hold short line ready to go and they still give me a void time.
Once you do establish communications (as short as you can imagine after commencing takeoff), they know that you are off. However, absent that, they assume you left before the void time or stayed on the ground.
Believe what you want, but that IS the reason. The system is predicated that if you depart from a towered field, ATC knows you left without you having to tell them. If you depart from a non-towered field, they have to make a contingency for not knowing.