There’s no line on Form 1040 that asks for your net worth. That single gap is what secretly wealthy retirees build their entire tax strategy around. A retired couple can carry a multi-million-dollar portfolio, spend six figures a year, and still show the IRS an income low enough to owe nothing. It isn’t a loophole, and it isn’t hiding money offshore — it’s a deliberate understanding of which dollars actually land on a tax return and which ones never do.

Take this example: a client retired with a $3.7 million portfolio and no Social Security income yet. We send them $15,000 a month — $180,000 a year — and their federal tax bill is zero. Here’s how that’s actually built.

Why Most of a Withdrawal Isn’t “Income” at All

Most people assume every dollar pulled from an investment account counts as taxable income. That assumption is where money gets lost.

In this client’s case, $1 million of the portfolio sits in a taxable brokerage account. Of that, 60% — $600,000 — is basis: money they already paid tax on years ago. When shares are sold to fund spending, most of what comes out is simply their own principal coming back to them. The IRS taxed those dollars once and doesn’t get to tax them again.

Here’s the math for the year:

The account throws off a 2% dividend, generating $20,000 without selling anything.

That leaves $160,000 to raise by selling investments.

Because 40% of the account is gain, only 40% of what’s sold is taxable — $64,000.

Total reported income: $84,000, not $180,000.

That’s where the second layer kicks in. For 2026, the 0% long-term capital gains bracket applies to married couples filing jointly with taxable income under $98,900. This couple, both over 65 and taking the standard deduction, gets to deduct $47,500 before a single dollar is taxed. Subtract that from $84,000, and taxable income lands at $36,500 — well under the $98,900 line. Every dollar of gain is taxed at 0%, and the federal bill on $180,000 of spending is nothing.

Most retirees would stop there and feel done. But they’d be leaving $62,400 of unused room under that 0% line on the table — and that room doesn’t carry forward. It disappears every January. Secretly wealthy retirees fill it deliberately, either by harvesting more gains to reset their cost basis higher or by converting IRA money to a Roth. (One caveat: this math is federal only — state rules vary, so check yours before assuming the whole bill disappears.)

Making Required IRA Withdrawals Disappear from the Return

Most retirees with a traditional IRA eventually hit required minimum distributions (RMDs) — starting at age 73 for those born 1951–1959, or 75 for those born 1960 or later. Most people take the full distribution, report all of it, and write a check.

A wealthy retiree does something different: a qualified charitable distribution (QCD). Say the RMD is $60,000. Instead of taking it all as income, $20,000 goes directly from the IRA to charities they were already planning to support. That $20,000 satisfies part of the RMD and never shows up on adjusted gross income. The IRS still gets its required distribution — the dollars are just invisible on the return. Reported IRA income drops from $60,000 to $40,000.

Four rules matter here, because the details trip people up:

The money must move directly from the IRA custodian to the charity — if the check comes to you first, it doesn’t count.

It has to come from an IRA, not a 401(k).

It cannot go to a donor-advised fund or a private foundation — only to a qualifying public charity.For 2026, the cap is $111,000 per person, or $222,000 for a couple who each hold their own IRA.

One important note: nobody should give to charity purely for the tax break. But for someone already giving, this is one of the most efficient ways to do it.

Borrowing Instead of Selling — A Bridge, Not a Habit

Sometimes a large, one-time expense hits at the worst point in the tax year — a $50,000 roof repair in July, for example, when a tax projection already shows you’re close to a bracket threshold or an IRMAA line (the income level that triggers higher Medicare premiums). Pulling $50,000 from an IRA or selling $50,000 of stock pushes income over that line.

The alternative: a securities-backed line of credit. It lets you pledge investments you already own and draw cash against them without selling a single share. Since a loan isn’t income, it never appears on the 1040.

This isn’t free money, and the numbers matter. A securities-backed line typically floats around 7%; $50,000 borrowed for six months runs about $1,750 in interest, which isn’t deductible for personal expenses. But compare that to the alternative: one IRMAA tier can cost a couple roughly $2,300 a year, and pushing $50,000 of gains from the 0% bracket into the 15% bracket costs $7,500. In both cases, the loan is cheaper — but only because the numbers were checked before borrowing. There’s real risk too: if markets drop far enough, a lender can require paying down the balance or pledging more assets. A $50,000 loan against a $1 million diversified account is a 5% loan-to-value ratio, which keeps that risk slim — but this is a bridge for a specific problem in a specific year, not a way to fund an ongoing lifestyle.

The Most Expensive Mistake: Wasting the “Tax Valley”

The years after retirement but before Social Security and RMDs begin are what we call the tax valley — a window where reported income drops and, on paper, a retiree looks poor to the IRS. Most people waste it by taking as little taxable income as possible every year, feeling good about a small tax bill, and letting a traditional IRA keep compounding untouched.

We worked with a couple — call them Dan and Victoria for confidentiality — who had a $3 million portfolio and large IRA balances. They landed right in the tax valley and could have stayed there. But their IRA was growing every year, and the RMDs waiting for them in their 70s were going to be enormous — pushing them into brackets they’d never seen, spiking Medicare premiums, and making more of their Social Security taxable, all at once, in years when they’d have the least flexibility to do anything about it.

So we made a different decision. Instead of looking poor in their 60s and getting crushed in their 70s, they’d look middle class the whole way through. Every year in the valley, we ran Roth conversions — moving money out of the traditional IRA on purpose, paying tax at a rate we chose, and filling the bracket deliberately, not to the top and not too little. We projected their potential lifetime tax savings at around $950,000.

This strategy works best for people five to ten years on either side of retirement, with a real mix of account types — the leverage shrinks every year that passes. It’s not about paying less tax this year. It’s about deciding what the next thirty years look like.

The Takeaway

None of this involves secrecy, offshore accounts, or anything illegal. Secretly wealthy retirees simply understand which dollars land on their tax return and which ones don’t — and they make that decision on purpose, every year, instead of all at once. The concepts aren’t complicated. The hard part is sequencing them correctly across decades without making one expensive mistake in the wrong year.

The Retirement Recap

Join the 1,000+ other retirees and get weekly articles and videos to help you retire with confidence. Subscribers also gain access to our private monthly client memo.

We will keep your email safe. You can unsubscribe at any time.

Seek Professional Guidance

Navigating retirement decisions can be complex. Consulting with a certified financial planner can provide personalized insights and strategies tailored to your unique circumstances. Whether you’re nearing retirement or planning ahead, expert advice can help you optimize your Social Security benefits and achieve greater financial confidence in your retirement years.

This does not constitute an investment recommendation. Investing involves risk. Past performance is no guarantee of future results. Consult your financial advisor for what is appropriate for you. Disclosures: https://onedegreeadvisors.com/disclosure/