IRS Audit Rates Over Time - How Taxes Impact Your Retirement-Income Strategy

August 3, 2023 Ronald Reinstein

IRS Audit Rates Over Time

IRS audit rates for individual income tax returns have fallen since 2010, but this pattern could reverse as the agency ramps up enforcement. The Inflation Reduction Act of 2022 provided the IRS with an influx of about $80 billion to modernize outdated technology and rebuild a depleted workforce.

Source: Bureau of Labor Statistics, 2023 (data through Dec. 2022); The Wall Street Journal, December 6, 2022

How Taxes Impact Your Retirement-Income Strategy

Retirees face several unique challenges when managing their income, particularly when it comes to taxes. From understanding how taxes relate to Social Security and Medicare to determining when to tap taxable and tax-advantaged accounts, individuals must juggle a complicated mix of factors.

Social Security and Medicare

People are sometimes surprised to learn that a portion of Social Security income becomes federally taxable when combined income exceeds $25,000 for single taxpayers and $32,000 for married couples filing jointly. The taxable portion is up to 85% of benefits, depending on income and filing status.1

In addition, the amount retirees pay in Medicare premiums each year is based on the modified adjusted gross income (MAGI) from two years earlier. In other words, the cost retirees pay for Medicare in 2023 is based on the MAGI reported on their 2021 returns.

Taxable, Tax-Deferred, or Tax-Free?

Maintaining a mix of taxable, tax-deferred, and tax-free accounts offers flexibility in managing income each year. However, determining when and how to tap each type of account and asset can be tricky. Consider the following points:

Taxable accounts. Income from most dividends and fixed-income investments and gains from the sale of securities held 12 months or less are generally taxed at federal rates as high as 37%. By contrast, qualified dividends and gains from the sale of securities held longer than 12 months are generally taxed at lower capital gains rates, which max out at 20%.

Tax-deferred accounts. Distributions from traditional IRAs, traditional work-sponsored plans, and annuities are also generally subject to federal income tax. On the other hand, company stock held in a qualified work-sponsored plan is typically treated differently. Provided certain rules are followed, a portion of the stock's value is generally taxed at the capital gains rate, no matter when it's sold; however, if the stock is rolled into a traditional IRA, it loses this special tax treatment.2

Tax-free accounts. Qualified distributions from Roth accounts and Health Savings Accounts (HSAs) are tax-free and therefore will not affect Social Security taxability and Medicare premiums. Moreover, some types of fixed-income investments offer tax-free income at the federal and/or state levels.3

The Impact of RMDs

One income-management strategy retirees often follow is to tap taxable accounts in the earlier years of retirement in order to allow the other accounts to continue benefiting from tax-deferred growth. However, traditional IRAs and workplace plans cannot grow indefinitely. Account holders must begin taking minimum distributions after they reach age 73 (for those who reach age 72 after December 31, 2022). Depending on an account's total value, an RMD could bump an individual or couple into a higher tax bracket. (RMDs are not required from Roth IRAs and, beginning in 2024, work-based plan Roth accounts during the primary account holder's lifetime.)

Don't Forget State Taxes

State taxes are also a factor. Currently, seven states impose no income taxes, while New Hampshire taxes dividend and interest income and Washington taxes the capital gains of high earners. Twelve states tax at least a portion of a retiree's Social Security benefits.

Eye on Washington

Finally, both current and future retirees will want to monitor congressional actions over the next few years. That's because today's historically low marginal tax rates are scheduled to revert to higher levels in 2026, unless legislation is enacted (see table).

Help Is Available

Putting together a retirement-income strategy that strives to manage taxes is a complex task indeed. Investors may want to seek the help of a qualified tax or financial professional before making any final decisions.4

Tax Rates Scheduled to Rise

Unless legislation is enacted, federal marginal income tax rates are scheduled to rise in 2026.

1) Combined income is the sum of adjusted gross income, tax-exempt interest, and 50% of any Social Security benefits received.

2) Distributions from tax-deferred accounts and annuities prior to age 59½ are subject to a 10% penalty, unless an exception applies.

3) A qualified distribution from a Roth account is one that is made after the account has been held for at least five years and the account holder reaches age 59½, dies, or becomes disabled. A distribution from an HSA is qualified provided it is used to pay for covered medical expenses (see IRS publication 502). Nonqualified distributions will be subject to regular income taxes and penalties.

4) There is no guarantee that working with a financial professional will improve investment results.

Should You Consider Tax-Loss Harvesting?

Stock market losses can be rough on your portfolio's bottom line, but they may also offer the potential to reduce your tax liability and possibly buy shares at a discount. Whether this strategy — called tax-loss harvesting — is appropriate for you depends on a variety of factors, including your current portfolio performance, your long-term goals, and your current and future taxable income.

Gains and Losses

When an investment loses money, it's often best to look beyond current performance and hold it for the long term. Sometimes, though, you may want to sell a losing investment, which could help balance gains from selling an investment that has appreciated or reduce your taxable income even if you do not have gains.

Capital gains and losses are classified as long term if the investment was held for more than one year, and short term if it was held for one year or less. Long-term gains are taxed at a rate of 0%, 15%, or 20% depending on your income. Short-term gains are taxed at your ordinary income tax rate, which may be much higher than your capital gains rate.

For tax purposes, capital losses are applied first to like capital gains and then to the other type of gains; for example, long-term losses are applied first to long-term gains and then to short-term gains. Up to $3,000 of any remaining losses can then be applied to your ordinary income for the current year ($1,500 if you are married filing separately). Finally, any remaining losses can be carried over to be applied to capital gains or ordinary income in future years. For most taxpayers, the biggest benefit comes when applying losses to short-term gains or ordinary income.

Selling, Buying, and Washing

Some investors sell losing investments with the idea of harvesting the tax loss and then buying the same investment while its price remains low. In order to discourage this, the IRS has a wash-sale rule, which prohibits buying "substantially identical stock or securities" within 30 days prior to or after a sale. This also applies to securities purchased by your spouse or a company you own.

It is impossible to time the market, but under the right circumstances, harvesting a tax loss and then buying the same security at least 30 days later (i.e., after the wash-sale period) could potentially result in a lower tax liability when you sell that security later at a gain.

2023 Income and Capital Gains Tax Rates

This is most likely if you repurchase the security at a similar or lower price, and you are in a higher tax bracket at the time you take the loss than at the time you take the gain — for example, if you take the loss while working and sell when you are retired.

Any year in which your taxable income falls within the 0% capital gains rate is an opportune time to take gains, and any losses in that year would be applied to short-term gains or ordinary income. Keep in mind that capital gains and losses apply only when investments are sold in a taxable account.

Tax-loss harvesting is a complex strategy, and it would be wise to consult your financial professional before taking action. Although there is no guarantee that working with a financial professional will improve investment results, a professional can evaluate your objectives and available resources and help you consider appropriate long-term financial strategies.

All investing involves risk, including the possible loss of principal, and there is no guarantee that any investment strategy will be successful.

A Mortgage Recast Is an Alternative to Refinancing

If you would like to reduce your monthly mortgage payment without having to refinance, then you may want to explore a mortgage recast. When you recast your mortgage, you put money toward the principal balance of your current home loan. Your mortgage lender then recalculates (reamortizes) your loan based on your new, lower balance, which reduces your monthly payment. Your interest rate and the number of years remaining on your loan stay the same. Here are three scenarios where a mortgage recast might be especially appealing.

You have extra cash on hand, perhaps from a bonus or an inheritance. It's sitting in a low-yield account.
You are close to retirement or retired. You want to keep your home but lower your monthly expenses.
You bought a new home with a smaller down payment than you intended because your old home is still on the market. But once your old home sells, the proceeds can be applied to your new mortgage through a recast.

Refinancing your mortgage may be a better option if your goal is to pay off your loan faster by shortening the term, or if you want to lower your interest rate or obtain cash. But if your objective is simply to lower your monthly payment and save on interest charges, then recasting your mortgage may be appropriate.

Recasting is generally simpler and less expensive than refinancing because you're keeping the same mortgage instead of applying for a new one. It doesn't require an extensive application, a credit check, a new appraisal, or closing costs, though you typically will need to pay a processing fee.

Check with Your Lender

Not all mortgage lenders offer recasts, and some types of loans, including FHA, VA, USDA, and certain jumbo loans are not eligible for recasting. If you do qualify for a recast, your lender will give you more details about the process.

You may be able to recast once you've increased your equity by making extra payments or by paying a lump sum toward your mortgage balance. Minimums vary, but the additional principal required may be as little as $5,000. Of course, the more you put toward your principal, the lower your future monthly mortgage payment. If you are currently paying principal mortgage insurance (PMI), putting a lump sum toward your mortgage may help erase that, further lowering your monthly payment.

One drawback of a mortgage recast is that it could tie up money you might need later for other purposes. To access your equity in the future, you may need to refinance, take out a home equity loan, or even sell your home.

IMPORTANT DISCLOSURES Broadridge Investor Communication Solutions, Inc. does not provide investment, tax, legal, or retirement advice or recommendations. The information presented here is not specific to any individual's personal circumstances. To the extent that this material concerns tax matters, it is not intended or written to be used, and cannot be used, by a taxpayer for the purpose of avoiding penalties that may be imposed by law. Each taxpayer should seek independent advice from a tax professional based on his or her individual circumstances. These materials are provided for general information and educational purposes based upon publicly available information from sources believed to be reliable — we cannot assure the accuracy or completeness of these materials. The information in these materials may change at any time and without notice.

Advisory Services offered through Independent Solutions Wealth

Management, LLC and Blackridge Asset Management,LLC, Registered Investment Advisers. Securities are offered through Peak Brokerage Services, LLC, Member FINRA/SIPC. Independent

Solutions Wealth Management, LLC and Blackridge Asset Management, LLC are separate and independent entities from Peak Brokerage Services, LLC.

Advisory Services offered through Independent Solutions Wealth Management, LLC and Blackridge Asset Management,LLC, Registered Investment Advisers. Securities are offered through Peak Brokerage Services, LLC, Member FINRA/SIPC. Independent Solutions Wealth Management, LLC and Blackridge Asset Management, LLC are separate and independent entities from Peak Brokerage Services, LLC.