Due to FAA shortsightedness, ultralight training is problematic. There are no 2 seat ultralights, so you have to train in an "ultralight like" 2 seater, or get some time in a light plane like a Cub or a Champ and then some transition training, which may be informal (and unpaid).
It also depends on what type of ultralight. What are you interested in?
For 3 axis ultralights (ultralight airplanes) it's especially problematic as there are very few suitable aircraft that aren't registered experimental, meaning they can't be used for commercial use, including renting to a student. There are very a very few ultralight like SLSA aircraft that can be used commercially.
For weight shift, I think it's a little better, though I don't know too much about that world.
For powered parachutes, I think it's a little better, there are some SLSA PPCs.
For powered paraglider (similar to but different from PPC) training is often included in the purchase price of new equipment. PPG is quite popular nowadays, and there are a lot of instructors.
For all of the above, you may have to travel.
Your best bet is to wander around to small airports (the smaller the better) in your area and ask. If there's any ultralight activity in the area, people will likely know of it ("no, nobody flies ultralights here, but there's a group over at Podunk airport...").