That's not accurate. If the AME opens the MedExpress, using the number you furnished him, then the alternatives are only to issue, defer, or deny. There's no walking away.
A smart approach, *if* your AME will cooperate, is to print out the BasicMed so the AME has it to look at... then schedule a...