Research / RateWalk: Forecasting Fed Decisions

Working paperWorking paper, July 2026. Not peer reviewed.

RateWalk: Forecasting Fed Rate Decisions with a Shrunk Markov Chain

Can a memoryless Markov chain on the Fed's policy moves forecast the next decision out of sample, and does conditioning on the inflation regime help?

Key results

3 of 3
countries where empirical-Bayes shrinkage beats both the unconditional and the naively conditioned chain out of sample (US, UK, Germany, 1990-2026)
1.059
US out-of-sample log-loss of the shrunk chain, vs 1.071 unconditional and 1.136 naively conditioned
1.056
log-loss of the adaptive blend with a Treasury-curve market proxy (proxy alone 1.199) over 319 decisions
72.7%
hit rate of the blend, vs 68.7% for the chain and 54.6% for the market proxy
82% / 85%
share of move months the market proxy wins, and of hold months the chain wins
Null
a duration-timing strategy on the signal does not beat a constant-duration bond risk-adjusted
Out-of-sample log-loss by country. Conditioning on the inflation regime raises it; empirical-Bayes shrinkage lowers it, in all three.
Figure 1. Out-of-sample log-loss by country. Conditioning on the inflation regime raises it; empirical-Bayes shrinkage lowers it, in all three.

Abstract

I ask whether a memoryless Markov chain on the Federal Reserve's policy moves can forecast the next rate decision out of sample, and whether conditioning the chain on the inflation regime improves it. Under strict no-look-ahead discipline, with CPI read at its real ALFRED release date so revisions never leak, the answer is a clean bias-variance story. A first-order chain beats a climatology baseline. Naive conditioning on the CPI regime overfits and hurts, because it splits sparse transition data across regimes. Shrinking each regime row toward the pooled chain (an empirical-Bayes Dirichlet prior) recovers a small but consistent edge that replicates across the United States, the United Kingdom, and Germany, survives a data-driven shrinkage strength, and sits on a broad parameter plateau rather than a tuned point. Against the market's own pricing, proxied by a walk-forward-calibrated Treasury-curve signal, the chain wins overall (log-loss 1.06 vs. 1.20) but the decomposition is sharper: the market is better on 82% of actual move months, the chain on 85% of holds, and a no-look-ahead adaptive blend beats both. The edge lives in probabilistic calibration: a duration-timing strategy built on the signal does not beat a constant-duration benchmark risk-adjusted. I report the negatives as part of the result.

Against a Treasury-curve proxy for market pricing, the market wins months with a move and the chain wins holds.
Figure 2. Against a Treasury-curve proxy for market pricing, the market wins months with a move and the chain wins holds.

Methods

  • Markov chains on policy-rate increments and CPI regimes, estimated walk-forward
  • CPI read at its first ALFRED release, so later revisions never leak into a past forecast
  • Empirical-Bayes Dirichlet shrinkage toward the pooled chain, with a data-driven strength
  • A fixed-income Monte Carlo behind the forecaster: yield-curve mapping, 5,000 paths, replayed GFC, Covid and SVB shocks, VaR and CVaR

What it does not show

  • The market benchmark is a Treasury-curve proxy, not fed funds futures.
  • The value is calibrated probabilities, not a tradeable duration signal.
Federal ReserveMarkov chainempirical Bayesforecast evaluationpoint-in-time data

Cite

BibTeX
@techreport{yadav2026ratewalk,
  title       = {RateWalk: Forecasting Fed Rate Decisions with a Shrunk Markov Chain},
  author      = {Yadav, Tanishk},
  year        = {2026},
  institution = {NYU Tandon School of Engineering},
  type        = {Working paper}
}

Tanishk Yadav

MS Financial Engineering at New York University, graduating May 2027, and looking for full-time quantitative research roles. My master's thesis measures, in real time, when US debt dynamics turn self-reinforcing.

More research

Other papers

SSRN preprintOctober 2026

Too Big to Co-Move

Concentrated sectors co-move less with the rest of the market: a one-point rise in top-three share lowers monthly R² by 0.75 points (permutation p = 0.04), though concentration does not explain why markets disconnected.

SSRN preprintSeptember 2026

Calm Months, Crash Months

Built with only past data, capped leverage and trading costs, volatility management lifts momentum's Sharpe ratio from 0.43 to 0.94 and helps none of the other five factors. A closed-form formula for momentum's market beta explains why.

Working paperJuly 2026

VolEdge: The Variance Risk Premium

A full-stack platform that extracts risk-neutral moments from live option chains without a pricing model; a GARCH vol-targeted sleeve beat SPY on risk (Sharpe 0.85 vs 0.68) while naive short-variance harvesting lost money.

SSRN preprintJuly 2026

Multi-Scale Regime Detection

Four independent stress signals that must agree before de-risking: maximum drawdown -6.2% vs -41.7% for SPY, and the same calibration transfers to factor and international portfolios.