TimesFM vs Laplace

Google · TimesFM 2.5 Apache-2.0 zero-shot one-step change series

TimesFM is a decoder-only, patched time-series transformer; we score version 2.5. Run zero-shot with a fixed 128-length context.

Resources: GitHub · Paper (arXiv 2310.10688)

Live snapshot  Derived from the week-long round-robin study; counts grow as coverage deepens. Everything scores against Laplace on the identical series and windows.

Standalone

The model's own predictive, run zero-shot, scored per series against Laplace by a one-step-ahead (k=1) Diebold–Mariano test on the log-score differential.

stratumnwin / draw / loss vs Laplace med ΔLLCRPS ratio cov₀₀
economic change-series, business-daily1328-0.780.9970.83
economic change-series, weekly2720-0.770.9640.83
economic change-series, monthly (annual cycle)2720-0.750.9510.80
M4 hourly, strongly seasonal414-0.510.9940.82
asset prices and returns, daily1392-0.681.0160.80
beats Laplace draw loses to Laplace

Median per-series Δ log-likelihood in nats (negative is worse than Laplace); CRPS ratio to Laplace (above 1 is worse); raw central-90% coverage (0.90 target).

Star plot

TimesFM standalone against Laplace, on the same six regime axes as the site's standalone radar. Each radius is the log-likelihood ratio, (wins + ½·ties) / n scaled so an even split with Laplace sits on the dashed 1.0 ring; outward beats Laplace more often, inward less. The M4-hourly set splits into soft and hard waveforms by corpus order, matching that radar.

economic (daily)weekly cyclesyearly cyclessoft waveformshard waveformsprice / returnsLaplace = 1.0economic (daily): log-likelihood ratio 0.17 vs Laplace (n=1339)weekly cycles: log-likelihood ratio 0.47 vs Laplace (n=2760)yearly cycles: log-likelihood ratio 0.25 vs Laplace (n=2760)soft waveforms: log-likelihood ratio 0.30 vs Laplace (n=180)hard waveforms: log-likelihood ratio 0.14 vs Laplace (n=234)price / returns: log-likelihood ratio 0.03 vs Laplace (n=1421)

Collaborative use

Two collaborative arms wrap TimesFM's own predictive. @lap lets Laplace forecast the model's normal scores, which fixes coverage; &lap holds Laplace and that wrap in a long-only online portfolio, so the blend is never much worse than Laplace alone. The recalibration pulls raw coverage back toward the 0.90 target, and the portfolio collapses the loss rate against Laplace.

stratumraw cov@lap cov raw loss&lap loss
economic change-series, business-daily0.830.9252%31%
economic change-series, weekly0.830.9043%15%
economic change-series, monthly (annual cycle)0.800.9138%6%
M4 hourly, strongly seasonal0.820.9137%1%
asset prices and returns, daily0.800.9243%5%

Central-90% coverage (0.90 target) and the fraction of series where the arm loses to Laplace by a Diebold–Mariano test.

Protocol

Fixed 128-length context, rolling one-step test window, no fitting, each model in its own environment. Strata split the cached FRED universe and the M4-hourly set by frequency and regime. Full method on the sidecar pattern page and in the methodology.

Architecture and methodology

TimesFM is a decoder-only transformer in the style of a language model. It splits the context into fixed-length patches, treats each patch as a token, and is pretrained on a large corpus of real and synthetic series. This study scores version 2.5 (200M parameters) with its continuous quantile head, which emits the predictive spread directly.