I'll be echoing some of the others, but figured I'd toss my 3 cents in (if it wasn't aviation related, it would be 2 cents).
Aviation is an expensive hobby. And the cost don't stop once you finish your training. If you want to buy an airplane, then buy an airplane. Just know that like training, the cost doesn't stop when the check gets cashed. However, in the long run, if you actually use your plane beyond earning your private ticket, the cost will be less compared to renting and the plane will always be there for you.
Before you go forward, think about your finances and goals. Can you afford the costs going forward? What will you do with the plane after training? Taking friends up for hops around the local area is cool and all, but will get old eventually. Look at places you would like to go for weekend trips and what not. There are a lot of places that are within a reasonable range of a 172 or similar from the Jax area.
If you do decide to get a plane, do some research. There are some tools on the AOPA website that may help you. Including figuring out your operating costs. Regardless, definitely get a pre-buy inspection before committing to any aircraft.
In regards to figuring your costs for the aircraft, consider separating fixed costs (hangar/tie down, insurance, etc.) and operating expense (gas, oil, maintenance fund, etc.). Doing this is sacralidge to some, but this way you will know how much that plane will cost you regardless of whether or not it flies.
One more side note, you may want to look around to airports outside the Jax area for basing your aircraft, depending on where you're actually living. If you're in Mandarin, St. Augustine might be a closer option for you. Similar if you're on the North Side, you might want to look at Fernandina. Palakta might be an option if you live in the Orange Park area. Bottom line is that there are options if you don't want to deal with Herlong/Craig/Cecil/JAX.
Good luck whichever way you go.