Since you paid all the costs, there is no violation. You haven't been compensated by anyone except yourself, and that's OK. The problem arises is when you receive compensation from someone else for providing air transportation to someone else. Since I'm not paying for the ride, it's perfectly OK for you to do me a favor by running me up to Lancaster to pick up my plane at Lancaster Avionics.
That said, if I happen to buy you lunch at Fiorentino's while we're there, it better be because I just felt like it and not because I was giving you lunch in exchange for the ride -- that would be a
quid pro quo, and constitute prohibited compensation.
The pilot in the Bobertz memo was collecting money from all passengers. That's the problem. He could certainly have given them all free rides legally, but once he started taking money, the line was crossed.
Dias makes clear that it's only a problem "if the pilot does not have to pay the costs of operating the aircraft". Since in your scenario, you're paying all the costs and logging all the time, there's no problem.
So relax and enjoy your lunch, and please don't fight me for the check and I
guarantee I won't tell the FAA, "I bought David lunch in return for a ride to Lancaster."