91.119 Minimum safe altitudes; general
Except when necessary for takeoff or landing, no person may operate an aircraft below the following altitudes:
(a) Anywhere – An altitude allowing, if a power unit fails, an emergency landing without undue hazard to persons or property on the surface.
(b) Over congested areas – Over any congested area of a city, town, or settlement, or over any open-air assembly of persons, an altitude of 1,000 feet above the highest obstacle within a horizontal radius of 2,000 feet of the aircraft.
(c) Over other than congested areas – An altitude of 500 feet above the surface except over open water or sparsely populated areas. In that case, the aircraft may not be operated closer than 500 feet to any person, vessel, vehicle, or structure.
VFR minimums (class E airspace):
Minimum Visibility: 3 statute miles
Clouds: 1,000 feet above 500 feet below 2,000 feet horizontal
(class E is is essential everywhere that is not an airport of special airspace e.g. restricted airspace)
Fun Fact: My sister told me about some guy that figured he would fly his Bonanza across the California central valley at the VFR minimums... yup... he ended up in a smushed ball... not sure what he hit, probably a power line (Bonanzas are fast).
I think an ultralight would be balls of fun if you live in the right part of the country (lots of open space). If you do it, LEARN HOW TO COMMIT TO AN EMERGENCY LANDING OR CRASH. I am from an aviation family (step father was a flight examiner). One of the prime thing that kills people is pilots doing everything not to do an emergency landing... stall... spin... ground... Sadly, it's generally something that is not trained.