You've worked your ass off for 20 years, have you?
My grandfather raised 6 kids, taught himself how to build his own family house (which was finished in the late 40s and stood until the mid-2000s), worked on a railroad, saved up enough money to buy a city block, so he sell parcels to other families at below market rate and farmed in his spare time. Oh, and he was black in the 1930s-1970s in the deep south.
You haven't worked your ass off. Trust me.
alternate answer - you need about $3-5 million to retire at 35 years of age.