Laplace Algorithm Empirical Results

One tiny, fast, online model against heavy machinery, on their respective home turf. As Malcolm Fraser once said, life wasn’t meant to be easy.

Strengths by regime

Five regimes plus a price/returns axis, one score each: how often a challenger beats laplace per series, ties split, scaled so a 50/50 draw is 1.0. The dashed ring is laplace itself; outside the ring the challenger is winning that regime, inside it is losing. Soft vs hard waveforms are the two halves of M4-Hourly (noisy daily cycles vs nearly deterministic ones; see the TBATS bout). Price/returns is the one axis laplace is not built for, and GARCH-t wins it decisively (~1.8x on 2500 return series). Pick up to six challengers — GARCH-t, Prophet, the foundation models and more. Entries marked (sandwiched) are drawn dashed: those models run inside laplace's own coordinates and beat it by construction, so they are collaboration, not a head-to-head win (see collaborative use). The default view includes the PyMC–laplace sandwich, which finishes ahead across the whole universe when run this way — the clearest case of cooperation beating competition.

 
regime

Should you use something else?

Quite possibly. laplace is one small, fast, online forecaster; the methods below range from classical workhorses to 200M-parameter foundation models, and several do their best work on particular ground: GARCH on price and return series, Viole's NNS on strongly seasonal data, TBATS where a soft daily cycle wants smoothing. The record below marks each of those corners where we found them, in its own row rather than averaged away. What laplace is for, and what it deliberately is not, is set out on the scope page, and the whole record is written up in the papers.

Should you use laplace with something else?

Very possibly — and it is the more interesting question. skaters cooperates as well as it competes: sandwiched in laplace's coordinates a challenger keeps its own strengths but inherits laplace's calibration and manufactured stationarity, and usually improves dramatically (the sandwich). PyMC, new but already strong, finishes ahead across the whole universe once sandwiched (+0.04 nats median on 65% of series) — it is the dashed entry in the star map above. Prophet, which wins only 4 of 921 pre-registered series raw, changes character entirely in these coordinates. So a bare horserace can mislead: these pages look for the series and regimes where each method does its best work, alone or sandwiched.

Featured bouts

The above caveats notwithstanding, Laplace does seem to outperform as a practical generalist model: fast, light, and with no dependencies.

TimesFM — David v Goliath

Google’s 200M-parameter foundation model: 69 of 69 continuous series on likelihood, a 2.26-nat median gap, and where Goliath actually wins (predicting zeros). The bout →

TabFM — David v Godzilla

TabFM is impressively competitive with laplace given its generality: a 12 GB tabular foundation model, pre-registered across eleven arms, meeting a specialist at one ten-thousandth its footprint. The bout →

Prophet

Prophet is now safe to use! See prophet.microprediction.org. Raw it won 4 of 921 pre-registered series; sandwiched, the story changes. The tape →

PYMC-Forecast — the day-one bout

PyMC is new but already great out of the box. Sandwiched it finishes ahead across the whole universe, +0.04 nats median on 65% of series; the pooling arm is the first with cross-series information. The bout →

The record

Numbers are per-series win-rates for laplace, log-likelihood first, CRPS second. Everyone is converted to the same Dist and scored by the same code on the same held-out points. Every row links its tape.

challengercornerLLCRPStape
AutoARIMA (statsforecast)classical82%53%study
auto.arima (real R)classical79%51%bout
AutoETSclassical97%83%study
ETS / SARIMAX (statsmodels)classical96% / 87%81% / 53%study
Theta (the M3 winner, R)classical87%63%bout
TBATS (forecast, R)classical96%89%bout
TBATS, soft-cycle hourly seriesclassicalits corner; smooth trigonometric seasonality earns it therebout
ADAM (smooth, R)state space96%82%bout
BSTS (full Bayesian posterior, R)state space97%80%bout
PYMC-Forecast 0.0.1 (PyMC Labs)Bayesian82%the day-one bout
nnetar (neural AR, R)neural96%76%bout
NF-StudentT (NeuralForecast)neural100%78%study
CSP (official csp-forecaster, 12 configs)conformal98–99%98–99%bout
CSP, strongly-seasonal series (M4-Hourly)conformalthe belt is theirs; seasonal pooling earns it therebout
AutoARIMA + conformal / ACIconformal86% / 88%31% / 29%study
TimesFM 2.5, 200M (Google)foundation100% cont.72% cont.David v Goliath
Chronos-Bolt (Amazon)foundation100% cont.88% cont.study
Moirai (Salesforce)foundation97% cont.93% cont.study
Lag-Llamafoundation99% cont.94% cont.study
TabFM 1.0 (Google, tabular)foundation71–88% (11 arms)38–60%David v Godzilla
Prophet (Meta)calendar GAM99.6%study
GARCH-t, non-price seriesheavy-tail SOTA68–82%53–54%bout
GARCH-t, price/return seriesheavy-tail SOTAthe belt is theirs; we recommend it therestudy

Challengers that earn a full treatment get a bout page: TimesFM, TabFM, and PYMC-Forecast so far. The next candidates are the native-density foundation models, Moirai and Lag-Llama, which came closest. Rematch conditions for TimesFM are tracked in skaters#97.

Send a challenger

The protocol is packaged and copyable: the benchmark-against-laplace skill for any distributional forecaster, and the timesfm-study skill for foundation models specifically. Same Dist, same code, same held-out points, both metrics, splits disclosed. Run it, and if your method wins, open an issue with the tape; the table takes new rows in either direction.

New bouts are pre-registered: the protocol, parameters and analysis plan are committed to benchmarks/preregistrations before the results are read, with everything already observed at filing disclosed. The first filed statement is the TabFM bout.