Macro factors explaining S&P 500 equity valuation

Macro factors explaining S&P 500 equity valuation

Equities 8 minutes to read
Peter Garnry

Chief Investment Strategist

Summary:  We show that macro variables on the US housing market, consumer confidence, change in money supply, the US 2-year yield, unemployment rate, hourly earnings, and lending standards are the most important macro variables for explaining the variance in the earnings yield on the S&P 500 in the period 1994-2022. Our earnings yield model also have long periods during the dot-com bubble and the Covid-19 pandemic where the predicted earnings yield is considerably above the actual earnings yield suggesting these two periods are driven by strong investor sentiment and optimism not explainable by the macro backdrop.


US housing market and consumer confidence are key for equity valuation

When we set out to build an earnings yield model on S&P 500 our aim was to find the factors that can explain the variation in the earnings yield. Our first model was using mostly aggregate company fundamentals on the S&P 500 such as EBIT margin, revenue growth, capex-to-sales etc., with the 12-month trailing earnings yield as the target in the model. This model was misspecified for several reasons including the 12-month trailing earnings yield being too volatile and lagging, but more importantly company fundamentals on the S&P 500 are economically related to earnings and thus not offering an interesting model driven by external variables from the companies themselves.

In the final model, we switched from aggregate fundamental data to time series on the US economy or financial markets other than the equity market. We also changed the earnings yield from 12-month trailing to 12-month forward because this variable is more stable, and the forward-looking nature of the variable is also more interesting and how the equity market operates. We started out with a simple linear regression, but since we are modelling the earnings yield and not changes in the earnings yield we could not get rid of the autocorrelation in the residuals, which is a key violation of the linear regression model assumptions. We therefore ended up with a random forest model which is a less strict model in terms of assumptions of residuals and the underlying distribution of the data. Our final model consists of 25 features describing different aspects of the US economy and financial markets.

From the random forest model we can compute the feature importance and based on the model output the features (ordered with the most important at the top) below are the ones that explain 50% of S&P 500 12-month forward earnings yield. The two most important features are the NAHB Index taking the temperature in the US housing market and consumer confidence. These two indicators remain currently above their historic average, but both are at risk with tighter financial conditions (and higher mortgage rates) and rising inflation putting pressure on consumers. The third most important feature in explaining the S&P 500 earnings yield is the yearly change in US home prices. In other words, the US housing market is very important for US equity valuations.

  • National Association of Home Builders Market Index
  • Conference Board Consumer Confidence
  • S&P CoreLogic Case-Shiller US National Home Price Index YoY
  • US Avg Hourly Earnings Private NFP YoY
  • Fed M2 YoY
  • US U-6 Unemployment Rate
  • Net % of Domestic Respondents Tightening Standards on loans for Large companies
  • US 2-year yield
Source: Bloomberg

Is the S&P 500 earnings yield at fair value?

Based on the model fit we can see whether the current 12-month earnings yield on the S&P 500 makes sense given the US economic backdrop. The current 12-month forward earnings yield on the S&P 500 is 5.15% or 19.4 in P/E terms and the model says the earnings yield should be 5.31% or 18.8 in P/E, based on the historical relationship between the earnings yield and the features, which is a small mispricing of 3%. In other words, given the current macro indicators the S&P 500 is correctly priced as you would expect is an efficient market.

What happens if we make a new prediction given that we change the most important features to some new values that are mostly in a worse direction?

  • National Association of Home Builders Market Index (from 79 to 70)
  • Conference Board Consumer Confidence (from 107.2 to 100)
  • S&P CoreLogic Case-Shiller US National Home Price Index YoY (from 19.2 to 10)
  • US Avg Hourly Earnings Private NFP YoY (from 6.7 to 5)
  • Fed M2 YoY (from 11 to 7)
  • US U-6 Unemployment Rate (from 6.9 to 6.5)
  • Net % of Domestic Respondents Tightening Standards on loans for Large companies (from -14.5 to 0)
  • US 2-year yield (unchanged at 2.5)

Based on the above changes holding the other variables constant, the model would predict an earnings yield of 18.2 or 6% below the current earnings yield.

Overreactions in the equity market

What is the most interesting about modelling the earnings yield on the S&P 500 with macro variables is that the earnings yield is consistently below the model’s earnings yield during the dot-com bubble period and the recent pandemic. The US equity market during these two periods is reflecting something else than the underlying macro indicators. Both periods were driven by excess investor sentiment and optimism leading to an overreaction relative to the economy. While the difference between the actual earnings yield and the model’s earnings yield is persistently negative over longer periods during sentiment-driven periods of optimism, the difference also exhibits short-lived spikes on the upside (the earnings yield being higher than the predicted value by the model).

There are four distinct periods where the equity market overreacts with a too high earnings yield relative to the macro backdrop and those are in late 2002 to early 2003 before the equity market bottoms out for good post the dot-com collapse, 2008-2009 during the financial crisis, late 2011 during the euro crisis, and again during in late 2018 during the Fed’s policy mistake on rates as the economy was deteriorating. In these periods the equity market is often driven by risk reductions and liquidity constraints accelerating selloffs more than what is warranted by economic data.

The important features are constantly changing

The final model is a random forest with its hyperparameters optimized using cross-validation. The model fit is based on the in-sample data using these optimized parameters. The idea is to explain the variance and not make predictions on future values of the earnings yield. In the cross-validation the model error is considerably larger (three times larger) than the errors seen in the in-sample fit (actual earnings yield vs the model’s earnings yield). What we see in the data is that the model’s ability to explain the variance in the earnings yield rapidly deteriorates after the model fit, which is not surprising.

The factors driving the earnings yield are time-varying and dynamic making the model inherently unstable. This means that the conclusions in this equity note are valid as of today but will begin changing over the next year. The US housing market has played a bigger role in the US economy since 1994 compared to the period before 1994, which likely explains its importance in explaining the earnings yield in the period 1994-2022. We expect other variables to grow in importance over time.

Quarterly Outlook

01 /

  • Upending the global order at blinding speed

    Quarterly Outlook

    Upending the global order at blinding speed

    John J. Hardy

    Global Head of Macro Strategy

    We are witnessing a once-in-a-lifetime shredding of the global order. As the new order takes shape, ...
  • Equity outlook: The high cost of global fragmentation for US portfolios

    Quarterly Outlook

    Equity outlook: The high cost of global fragmentation for US portfolios

    Charu Chanana

    Chief Investment Strategist

  • Asset allocation outlook: From Magnificent 7 to Magnificent 2,645—diversification matters, now more than ever

    Quarterly Outlook

    Asset allocation outlook: From Magnificent 7 to Magnificent 2,645—diversification matters, now more than ever

    Jacob Falkencrone

    Global Head of Investment Strategy

  • Commodity Outlook: Commodities rally despite global uncertainty

    Quarterly Outlook

    Commodity Outlook: Commodities rally despite global uncertainty

    Ole Hansen

    Head of Commodity Strategy

  • Macro outlook: Trump 2.0: Can the US have its cake and eat it, too?

    Quarterly Outlook

    Macro outlook: Trump 2.0: Can the US have its cake and eat it, too?

    John J. Hardy

    Global Head of Macro Strategy

  • Equity Outlook: The ride just got rougher

    Quarterly Outlook

    Equity Outlook: The ride just got rougher

    Charu Chanana

    Chief Investment Strategist

  • China Outlook: The choice between retaliation or de-escalation

    Quarterly Outlook

    China Outlook: The choice between retaliation or de-escalation

    Charu Chanana

    Chief Investment Strategist

  • Commodity Outlook: A bumpy road ahead calls for diversification

    Quarterly Outlook

    Commodity Outlook: A bumpy road ahead calls for diversification

    Ole Hansen

    Head of Commodity Strategy

  • FX outlook: Tariffs drive USD strength, until...?

    Quarterly Outlook

    FX outlook: Tariffs drive USD strength, until...?

    John J. Hardy

    Global Head of Macro Strategy

  • Fixed Income Outlook: Bonds Hit Reset. A New Equilibrium Emerges

    Quarterly Outlook

    Fixed Income Outlook: Bonds Hit Reset. A New Equilibrium Emerges

    Althea Spinozzi

    Head of Fixed Income Strategy

Content disclaimer

The information on or via the website is provided to you by Saxo Bank (Switzerland) Ltd. (“Saxo Bank”) for educational and information purposes only. The information should not be construed as an offer or recommendation to enter into any transaction or any particular service, nor should the contents be construed as advice of any other kind, for example of a tax or legal nature.

All trading carries risk. Loses can exceed deposits on margin products. You should consider whether you understand how our products work and whether you can afford to take the high risk of losing your money.

Saxo Bank does not guarantee the accuracy, completeness, or usefulness of any information provided and shall not be responsible for any errors or omissions or for any losses or damages resulting from the use of such information.

The content of this website represents marketing material and is not the result of financial analysis or research. It has therefore has not been prepared in accordance with directives designed to promote the independence of financial/investment research and is not subject to any prohibition on dealing ahead of the dissemination of financial/investment research.

Please refer to our full disclaimer and notification on non-independent investment research for more details.
- Notification on Non-Independent Investment Research (https://www.home.saxo/legal/niird/notification)
- Full disclaimer (https://www.home.saxo/en-ch/legal/disclaimer/saxo-disclaimer)

Saxo Bank (Schweiz) AG
The Circle 38
CH-8058
Zürich-Flughafen
Switzerland

Contact Saxo

Select region

Switzerland
Switzerland

All trading carries risk. Losses can exceed deposits on margin products. You should consider whether you understand how our products work and whether you can afford to take the high risk of losing your money. To help you understand the risks involved we have put together a general Risk Warning series of Key Information Documents (KIDs) highlighting the risks and rewards related to each product. The KIDs can be accessed within the trading platform. Please note that the full prospectus can be obtained free of charge from Saxo Bank (Switzerland) Ltd. or the issuer.

This website can be accessed worldwide however the information on the website is related to Saxo Bank (Switzerland) Ltd. All clients will directly engage with Saxo Bank (Switzerland) Ltd. and all client agreements will be entered into with Saxo Bank (Switzerland) Ltd. and thus governed by Swiss Law. 

The content of this website represents marketing material and has not been notified or submitted to any supervisory authority.

If you contact Saxo Bank (Switzerland) Ltd. or visit this website, you acknowledge and agree that any data that you transmit to Saxo Bank (Switzerland) Ltd., either through this website, by telephone or by any other means of communication (e.g. e-mail), may be collected or recorded and transferred to other Saxo Bank Group companies or third parties in Switzerland or abroad and may be stored or otherwise processed by them or Saxo Bank (Switzerland) Ltd. You release Saxo Bank (Switzerland) Ltd. from its obligations under Swiss banking and securities dealer secrecies and, to the extent permitted by law, data protection laws as well as other laws and obligations to protect privacy. Saxo Bank (Switzerland) Ltd. has implemented appropriate technical and organizational measures to protect data from unauthorized processing and disclosure and applies appropriate safeguards to guarantee adequate protection of such data.

Apple, iPad and iPhone are trademarks of Apple Inc., registered in the U.S. and other countries. App Store is a service mark of Apple Inc.