Laplace Algorithm Empirical Results
One tiny, fast, online model against heavy machinery, on their respective home turf. As Malcolm Fraser once said, life wasn’t meant to be easy.
Strengths by regime
Five regimes plus a price/returns axis, one score each: how often a
challenger beats laplace per series, ties split, scaled so a
50/50 draw is 1.0. The dashed ring is laplace itself; outside
the ring the challenger is winning that regime, inside it is losing. Soft
vs hard waveforms are the two halves of M4-Hourly (noisy daily cycles
vs nearly deterministic ones; see the
TBATS bout).
Price/returns is the one axis laplace is not built for, and
GARCH-t wins it decisively (~1.8x on 2500 return series).
Pick up to six challengers — GARCH-t, Prophet, the
foundation models and more. Entries marked (sandwiched) are drawn
dashed: those models run inside laplace's own
coordinates and beat it by construction, so they are collaboration, not a
head-to-head win (see collaborative use). The
default view includes the PyMC–laplace sandwich,
which finishes ahead across the whole universe when run this way —
the clearest case of cooperation beating competition.
| regime |
|---|
Should you use something else?
Quite possibly. laplace is one small, fast, online forecaster; the methods below range from classical workhorses to 200M-parameter foundation models, and several do their best work on particular ground: GARCH on price and return series, Viole's NNS on strongly seasonal data, TBATS where a soft daily cycle wants smoothing. The record below marks each of those corners where we found them, in its own row rather than averaged away. What laplace is for, and what it deliberately is not, is set out on the scope page, and the whole record is written up in the papers.
Should you use laplace with something else?
Very possibly — and it is the more interesting question. skaters cooperates as well as it competes: sandwiched in laplace's coordinates a challenger keeps its own strengths but inherits laplace's calibration and manufactured stationarity, and usually improves dramatically (the sandwich). PyMC, new but already strong, finishes ahead across the whole universe once sandwiched (+0.04 nats median on 65% of series) — it is the dashed entry in the star map above. Prophet, which wins only 4 of 921 pre-registered series raw, changes character entirely in these coordinates. So a bare horserace can mislead: these pages look for the series and regimes where each method does its best work, alone or sandwiched.
Featured bouts
The above caveats notwithstanding, Laplace does seem to outperform as a practical generalist model: fast, light, and with no dependencies.
TimesFM — David v Goliath
Google’s 200M-parameter foundation model: 69 of 69 continuous series on likelihood, a 2.26-nat median gap, and where Goliath actually wins (predicting zeros). The bout →
TabFM — David v Godzilla
TabFM is impressively competitive with laplace given its generality: a 12 GB tabular foundation model, pre-registered across eleven arms, meeting a specialist at one ten-thousandth its footprint. The bout →
Prophet
Prophet is now safe to use! See prophet.microprediction.org. Raw it won 4 of 921 pre-registered series; sandwiched, the story changes. The tape →
PYMC-Forecast — the day-one bout
PyMC is new but already great out of the box. Sandwiched it finishes ahead across the whole universe, +0.04 nats median on 65% of series; the pooling arm is the first with cross-series information. The bout →
The record
Numbers are per-series win-rates for laplace,
log-likelihood first, CRPS second. Everyone is converted to the same
Dist and scored by the same code on the same held-out
points. Every row links its tape.
| challenger | corner | LL | CRPS | tape |
|---|---|---|---|---|
| AutoARIMA (statsforecast) | classical | 82% | 53% | study |
| auto.arima (real R) | classical | 79% | 51% | bout |
| AutoETS | classical | 97% | 83% | study |
| ETS / SARIMAX (statsmodels) | classical | 96% / 87% | 81% / 53% | study |
| Theta (the M3 winner, R) | classical | 87% | 63% | bout |
| TBATS (forecast, R) | classical | 96% | 89% | bout |
| TBATS, soft-cycle hourly series | classical | its corner; smooth trigonometric seasonality earns it there | bout | |
| ADAM (smooth, R) | state space | 96% | 82% | bout |
| BSTS (full Bayesian posterior, R) | state space | 97% | 80% | bout |
| PYMC-Forecast 0.0.1 (PyMC Labs) | Bayesian | 82% | — | the day-one bout |
| nnetar (neural AR, R) | neural | 96% | 76% | bout |
| NF-StudentT (NeuralForecast) | neural | 100% | 78% | study |
CSP (official csp-forecaster, 12 configs) | conformal | 98–99% | 98–99% | bout |
| CSP, strongly-seasonal series (M4-Hourly) | conformal | the belt is theirs; seasonal pooling earns it there | bout | |
| AutoARIMA + conformal / ACI | conformal | 86% / 88% | 31% / 29% | study |
| TimesFM 2.5, 200M (Google) | foundation | 100% cont. | 72% cont. | David v Goliath |
| Chronos-Bolt (Amazon) | foundation | 100% cont. | 88% cont. | study |
| Moirai (Salesforce) | foundation | 97% cont. | 93% cont. | study |
| Lag-Llama | foundation | 99% cont. | 94% cont. | study |
| TabFM 1.0 (Google, tabular) | foundation | 71–88% (11 arms) | 38–60% | David v Godzilla |
| Prophet (Meta) | calendar GAM | 99.6% | — | study |
| GARCH-t, non-price series | heavy-tail SOTA | 68–82% | 53–54% | bout |
| GARCH-t, price/return series | heavy-tail SOTA | the belt is theirs; we recommend it there | study | |
Challengers that earn a full treatment get a bout page: TimesFM, TabFM, and PYMC-Forecast so far. The next candidates are the native-density foundation models, Moirai and Lag-Llama, which came closest. Rematch conditions for TimesFM are tracked in skaters#97.
Send a challenger
The protocol is packaged and copyable: the
benchmark-against-laplace
skill for any distributional forecaster, and the
timesfm-study skill for
foundation models specifically. Same Dist, same code,
same held-out points, both metrics, splits disclosed. Run it, and if
your method wins, open an
issue with the tape; the table takes new rows in either
direction.
New bouts are pre-registered: the protocol, parameters and analysis plan are committed to benchmarks/preregistrations before the results are read, with everything already observed at filing disclosed. The first filed statement is the TabFM bout.