I have quite a bit of flight time and I have an A&P mechanics license. It really doesn't matter what you learn to fly in but if it was me I would try to learn in something similar to what you would be flying on a regular basis. Whether it's something you own or rent. The glass stuff is easy as hell to use but the older analog stuff not so much. So it's probably better to learn that. you have to be careful buying older used aircraft. you have to know all of it's history. which is easy to do if you spend some time looking through the logs. Engine overhauls are brutally expensive so be very weary of high time engines. Paying for a good mechanic to inspect it first would be highly recommended. All that being said, there isn't a cooler feeling in the world than your first solo!
Agree with all of this. Owners of airplanes generally know what they are worth. If it sounds really cheap, it probably won't be in the long run. Annual maintenance is a must and there is nothing inexpensive with an airplane. That being said, there is something so relaxing and fun about flying wherever you want to go. Another item that affects price of an airplane is the radios and other flight data. If you just want to fly around home and check into your small local airport with no control towner than a simple communication radio is fine. If you are going to be flying longer distances and into larger airport then you will want better radio equipment. If you're going to purchase your own airplane, take someone along who knows what to look for. A good looking airplane with nice paint may need thousands of dollars to make it flight ready.
There are very good reasons for having all the rules of maintenance on an airplane. When you are in the air and your engine quits you don't just coast to the side of the road. Instead you coast (glide) until you are close enough to the ground where you
will land. Better to have a choice of where you land than wherever the plane takes you. The good news is that well maintained airplanes are very reliable. Most forced landings are pilot error and not airplane malfunctions.
To make your choice, talk to airplane owners in the area or that you know; talk to instructors you may want to take lessons from, etc. I'd recommend you start if you wish but do some research first as you have now done by looking for suggestions here. Good Luck and I would think you could find an instructor in your area who would be happy to give a preliminary flight at a very affordable price. Pretty sure after that first flight you will be hooked.