Your Banker Knew Your Name—and Decided If You Deserved a House: Mortgages Before the Algorithm

It's 1955. You want to buy a house. You walk into First National Bank on Main Street and ask to speak with the loan officer. His name is Mr. Patterson. He knows your father. He's seen you grow up. You sit in his office, and he begins asking questions.

Not about your credit score—that doesn't exist yet. Not about your debt-to-income ratio—that's not standardized. He's asking about your job. Your character. Whether you attend church. Whether your wife is likely to spend money frivolously. Whether you "seem like the type" who will keep up with payments. He pulls out a map and looks at the neighborhood where you want to buy. He makes notes. He tells you he'll think about it and let you know.

Two weeks later, you get a call. You've been approved. Or you haven't. There's no explanation. There's no appeals process. Mr. Patterson has decided.

Now fast forward to 2024. You open your laptop and visit LendingTree. You fill out an online form. Within hours, you have pre-approval offers from six different lenders. You can see the exact interest rate you'll pay. You can compare terms side-by-side. You can apply for a mortgage without ever meeting a human being. The process is transparent, standardized, and efficient.

On the surface, this is unambiguous progress. The old system was opaque, arbitrary, and deeply discriminatory. The new system is fair, competitive, and accessible. But there's a catch—one that reveals how progress in one area can mask regression in another.

The Gatekeeper Economy

In the mid-20th century, homeownership was gatekept by a handful of people: your local banker, your employer, and the government. These gatekeepers were human beings with biases, but they also had something else—skin in the game.

If Mr. Patterson approved a mortgage to someone who couldn't pay it back, that was his bank's problem. He had incentive to be careful. He had to live in the same town as his borrowers. His reputation was on the line. So while his decisions were subjective and often discriminatory, they were at least made by someone who bore the consequences.

The barriers to homeownership were real and significant. You needed a 20% down payment—non-negotiable. You needed to demonstrate stable employment, ideally with the same employer for several years. You needed references. You needed to be the "right kind" of person, which in practice meant you needed to be white, married, and living in an approved neighborhood.

Redlining—the practice of refusing mortgages in certain neighborhoods based on race—was not just common; it was official policy. Banks would literally draw red lines on maps around Black neighborhoods and refuse to lend there. Government agencies like the Home Owners' Loan Corporation (HOLC) created residential security maps that explicitly coded neighborhoods by race and deemed Black neighborhoods ineligible for federally-backed mortgages. This wasn't a side effect of the system. It was the system.

So when we talk about the "golden age" of homeownership in the 1950s, we're talking about an era when homeownership was systematically denied to millions of Americans based on race.

The Democratization That Didn't Quite Work

Starting in the 1960s and accelerating through the 1980s and 1990s, the mortgage industry was reformed. Federal protections were put in place. Redlining was made illegal. Lending standards were standardized and documented. Credit scores were introduced. The process became more transparent and, crucially, more competitive.

This was genuine progress. It opened homeownership to people who had been systematically excluded. It removed the arbitrary gatekeeping of local bankers. It made the process more fair.

But it also changed the incentive structure. When mortgages could be packaged and sold to investors—when your local bank didn't have to care whether you could actually pay back the loan—the gatekeeper's skin in the game disappeared. The 2008 financial crisis was, in many ways, a symptom of this: banks had removed the friction of caring whether borrowers could repay.

Today's mortgage process is theoretically more democratic. But it operates in a different economic reality.

The New Barrier: The Price Itself

Here's what's changed: it's no longer about whether you can get approved for a mortgage. It's about whether you can afford the down payment and the monthly payment in the first place.

In 1950, the median home price was about $8,000. The median household income was around $3,000. So a home cost about 2.7 times the annual household income. With a 20% down payment, you needed $1,600 in savings—roughly six months of household income.

That was a significant barrier, but it was achievable for middle-class families, especially with two incomes and some saving discipline.

In 2024, the median home price is around $430,000. The median household income is around $75,000. A home now costs about 5.7 times annual household income. With a 20% down payment, you need $86,000 in savings—more than a full year of household income.

And that's just the down payment. The monthly mortgage payment, taxes, insurance, and maintenance are proportionally much higher too.

The barriers have shifted from being about approval to being about affordability. You don't need a banker's permission anymore. You need a six-figure bank account.

The Irony of Accessibility

In theory, modern lending is more accessible. You can get approved with a smaller down payment. FHA loans allow as little as 3.5% down. Lenders compete for your business. The process is transparent and fast.

But this accessibility only matters if you can actually afford the house. And for most Americans under 40, that's becoming increasingly difficult. First-time homebuyers now have a median age of 36, compared to 30 in the 1980s. Many are waiting longer, saving harder, and still struggling to find something they can afford.

Meanwhile, investors and wealthy buyers have moved in. Because while the barriers to homeownership have dropped for individuals, the absolute price of homes has skyrocketed. This has attracted institutional money. Hedge funds and real estate investment trusts now own significant portions of the single-family housing stock, further driving up prices.

So we've created a system that's theoretically more fair but practically more unequal. The discrimination is no longer explicit (though it still exists in subtle forms). It's baked into the price itself.

What We Gained and What We Lost

The old mortgage system was exclusionary, opaque, and deeply racist. No one should want to go back to it. The reforms of the past 60 years have genuinely improved fairness and access.

But the reforms also removed something: the constraint that forced housing to remain somewhat affordable. When Mr. Patterson approved a mortgage, he was thinking about whether a teacher or factory worker could actually pay it back. He wasn't thinking about investment returns or portfolio appreciation. The house was shelter, not speculation.

Today's mortgage market is efficient and competitive, which is great if you have the capital to participate. But it's also driven by capital, which means it optimizes for returns rather than affordability.

The irony is sharp: we removed the arbitrary gatekeepers, only to discover that price itself is a more ruthless gatekeeper than any banker ever was. Mr. Patterson could at least be reasoned with. The market is harder to negotiate with.

So here we are: homeownership is theoretically more accessible, but practically less achievable. We've solved the discrimination problem and created an affordability crisis instead. It's progress, but it's the kind of progress that trades one barrier for another—and leaves millions of people on the wrong side of both.