Don't feel bad, if some a hole wants to buy a house near the airport, they shouldn't be complaining about the noise. NO FARs were broken, and if the local whiners make an issue of it. You were cleared for takeoff, if in another area, you were flying the airplane in matter you deemed necessary as PIC.