Logistic growth benchmarks
52 of 52 cases match Python Prophet.
Each case runs the same input through Effect Prophet and Python Prophet 1.4.0, then compares every forecast row, the trend, each component and the fitted noise. A case matches when all of them agree within its tolerances, and only matching cases are timed.
Each case's dot shows its result: matches, matches with internal differences flagged, intentional difference, doesn't match. Hover over a dot for details.
How to read the tables:
- Effect output and Python output are each library's final forecast value. Open a case to see every row side by side.
- Largest difference is the biggest gap between the two forecasts, as a share of the input data's range.
- Effect time and Python time are the median time for the timed step, usually fitting and predicting. Open a case for every step, including first-run and save/load times.
- Flagged cases match, but the two libraries stopped their fitting search at slightly different points. The case page shows the internal numbers.
About this run
- Run
2026-10-20T174321-690Z-27b7ec98on 2026-10-20, commit27b7ec9 - Both libraries ran in
linux/arm64containers on Apple M4 Pro - effect-prophet 0.0.0
- effect 4.0.0
- prophet 1.4.0
- Full benchmark report
Timings come from one machine and describe this workload only. They are not a general speed ranking. Where Python is faster, it is often because Python runs Stan's optimizer as compiled C++, while Effect Prophet runs the same algorithm as WebAssembly with narrower vector instructions. The gap is widest for Newton's method on short histories with many parameters.
Country holiday calendars
Pinned country calendars, matching explicit-event controls, dynamic future years and portable saved models. Known-gap opt-in is partial provider output, not a completeness guarantee.
| Case | Input | Effect output | Python output | Largest difference | Timed step | Effect time | Python time |
|---|---|---|---|---|---|---|---|
| US holidays, additive | 96 rows | 80.5727 | 80.5727 | < 0.0001% | Fit and predict | 31.5 ms | 60.1 ms |
| Explicit US control, additive | 96 rows | 80.5727 | 80.5727 | < 0.0001% | Fit and predict | 30.7 ms | 54.4 ms |
| US holidays, multiplicative | 96 rows | 86.0085 | 86.0085 | < 0.0001% | Fit and predict | 44.0 ms | 66.0 ms |
| Explicit US control, multiplicative | 96 rows | 86.0085 | 86.0085 | < 0.0001% | Fit and predict | 43.3 ms | 62.9 ms |
Default settings
fit(history, { growth: "logistic" }) against Prophet(growth="logistic").fit(df) with nothing else set. Each library decides on its own which seasonal patterns, changepoints and optimizer to use.
| Case | Input | Effect output | Python output | Largest difference | Timed step | Effect time | Python time |
|---|---|---|---|---|---|---|---|
| Defaults, three months of daily data | 96 rows | 105.2798 | 105.2798 | < 0.0001% | Fit | 102 ms | 123 ms |
| Defaults, eight months of daily data | 256 rows | 113.0552 | 113.0552 | 0.0012% | Fit | 37.7 ms | 42.7 ms |
| Defaults, a year with changing growth | 365 rows | 193.9557 | 193.9523 | 0.0086% | Fit | 133 ms | 121 ms |
Growth curves and changepoints
An S-shaped curve rising toward a slowly changing ceiling, with no changepoints, one hand-picked changepoint or automatic ones, under both target scalings. Three cases sit either side of 100 rows, where both libraries switch from Newton to L-BFGS.
| Case | Input | Effect output | Python output | Largest difference | Timed step | Effect time | Python time |
|---|---|---|---|---|---|---|---|
| No changepoints, absmax scaling | 96 rows | 105.2742 | 105.2742 | < 0.0001% | Fit | 6.78 ms | 12.7 ms |
| One hand-picked changepoint, absmax scaling | 96 rows | 105.2754 | 105.2754 | < 0.0001% | Fit | 8.59 ms | 15.2 ms |
| Three automatic changepoints, absmax scaling | 96 rows | 105.2760 | 105.2760 | < 0.0001% | Fit | 19.0 ms | 30.2 ms |
| No changepoints, minmax scaling | 96 rows | 106.7569 | 106.7569 | < 0.0001% | Fit | 8.51 ms | 15.8 ms |
| One hand-picked changepoint, minmax scaling | 96 rows | 105.7871 | 105.7871 | < 0.0001% | Fit | 16.8 ms | 24.2 ms |
| Three automatic changepoints, minmax scaling | 96 rows | 105.5809 | 105.5809 | < 0.0001% | Fit | 9.52 ms | 18.0 ms |
| No changepoints, loose prior, absmax scaling | 96 rows | 99.6666 | 99.6666 | < 0.0001% | Fit | 116 ms | 128 ms |
| No changepoints, loose prior, minmax scaling | 96 rows | 93.1168 | 93.1168 | < 0.0001% | Fit | 15.2 ms | 20.5 ms |
| 99 rows: just under the optimizer switch | 99 rows | 105.3754 | 105.3754 | < 0.0001% | Fit | 16.9 ms | 26.5 ms |
| 100 rows: just over the optimizer switch | 100 rows | 105.4111 | 105.4111 | < 0.0001% | Fit | 1.85 ms | 7.74 ms |
| Eight months of daily data | 256 rows | 113.6759 | 113.6759 | < 0.0001% | Fit | 2.82 ms | 7.89 ms |
| Weekly pattern, absmax scaling | 96 rows | 71.7786 | 71.7786 | < 0.0001% | Fit and predict | 18.9 ms | 32.6 ms |
| Weekly pattern, minmax scaling | 96 rows | 71.9060 | 71.9060 | < 0.0001% | Fit and predict | 20.5 ms | 34.5 ms |
| Weekly pattern, automatic changepoints | 96 rows | 71.9000 | 71.9000 | < 0.0001% | Fit and predict | 18.9 ms | 32.6 ms |
| Weekly pattern, eight months | 256 rows | 98.0804 | 98.0804 | < 0.0001% | Fit and predict | 4.32 ms | 12.9 ms |
Floors and ceilings
Histories with an explicit floor as well as a ceiling, both changing over time. Values are measured from the floor, as in Prophet.
| Case | Input | Effect output | Python output | Largest difference | Timed step | Effect time | Python time |
|---|---|---|---|---|---|---|---|
| Explicit floor, absmax scaling | 96 rows | 105.8329 | 105.8329 | < 0.0001% | Fit | 7.75 ms | 13.8 ms |
| Explicit floor, minmax scaling | 96 rows | 105.8329 | 105.8329 | < 0.0001% | Fit | 11.6 ms | 19.2 ms |
| Explicit floor with a regressor, absmax scaling | 96 rows | 72.2190 | 72.2190 | < 0.0001% | Fit and predict | 21.5 ms | 35.9 ms |
| Explicit floor with a regressor, minmax scaling | 96 rows | 72.2190 | 72.2190 | < 0.0001% | Fit and predict | 18.5 ms | 30.1 ms |
Seasonality, events and regressors
Each supported effect on its own, then all of them together: a weekly pattern, a switchable weekly pattern, an event with a window, and additive and multiplicative regressors.
| Case | Input | Effect output | Python output | Largest difference | Timed step | Effect time | Python time |
|---|---|---|---|---|---|---|---|
| Weekly pattern | 96 rows | 105.2764 | 105.2764 | < 0.0001% | Fit | 15.6 ms | 27.5 ms |
| Switchable weekly pattern | 96 rows | 105.2763 | 105.2763 | < 0.0001% | Fit | 16.2 ms | 28.3 ms |
| Event with a window | 96 rows | 105.2751 | 105.2751 | < 0.0001% | Fit | 9.09 ms | 17.9 ms |
| Additive regressor | 96 rows | 105.2753 | 105.2753 | < 0.0001% | Fit | 7.94 ms | 15.8 ms |
| Multiplicative regressor | 96 rows | 105.2751 | 105.2751 | < 0.0001% | Fit | 11.3 ms | 18.6 ms |
| Everything at once, absmax scaling | 96 rows | 105.8453 | 105.8453 | < 0.0001% | Fit | 29.0 ms | 46.6 ms |
| Everything at once, minmax scaling | 96 rows | 105.8453 | 105.8453 | < 0.0001% | Fit | 25.3 ms | 44.0 ms |
Unusual data
Shuffled rows, repeated dates, a falling curve, a curve pinned at its ceiling, a perfectly constant series and values outside the bounds.
| Case | Input | Effect output | Python output | Largest difference | Timed step | Effect time | Python time |
|---|---|---|---|---|---|---|---|
| Shuffled rows | 96 rows | 105.2754 | 105.2754 | < 0.0001% | Fit | 8.28 ms | 17.9 ms |
| Repeated dates | 96 rows | 103.2373 | 103.2373 | < 0.0001% | Fit | 6.01 ms | 16.7 ms |
| Falling curve | 96 rows | 4.2479 | 4.2479 | < 0.0001% | Fit | 8.25 ms | 16.2 ms |
| Pinned at the ceiling | 96 rows | 109.5200 | 109.5200 | < 0.0001% | Fit | 10.9 ms | 20.3 ms |
| Perfectly constant | 96 rows | 49.9301 | 49.9301 | 7.9e-12 | Fit | 17.8 ms | 26.7 ms |
| Values outside the bounds | 96 rows | 106.0168 | 106.0168 | < 0.0001% | Fit | 9.04 ms | 16.6 ms |
Uncertainty ranges
Both libraries simulate possible futures with random draws, so individual simulated values never match. Each range must still match Python's within the variation expected from that many draws.
| Case | Input | Effect output | Python output | Largest difference | Timed step | Effect time | Python time |
|---|---|---|---|---|---|---|---|
| Defaults, ranges with changing growth | 365 rows | 193.9557 | 193.9523 | 0.0086% | Simulate uncertainty | 23.5 ms | 282 ms |
| Defaults, ranges with changing growth, second seed | 365 rows | 193.9557 | 193.9523 | 0.0086% | Simulate uncertainty | 23.1 ms | 288 ms |
| Samples, weekly pattern | 96 rows | 71.9060 | 71.9060 | < 0.0001% | Simulate uncertainty | 1.22 ms | 80.7 ms |
| Ranges, eight months | 256 rows | 98.0804 | 98.0804 | < 0.0001% | Simulate uncertainty | 861 µs | 26.6 ms |
| Ranges with an explicit floor | 96 rows | 72.2190 | 72.2190 | < 0.0001% | Simulate uncertainty | 945 µs | 89.0 ms |
| Samples with an explicit floor | 96 rows | 72.2190 | 72.2190 | < 0.0001% | Simulate uncertainty | 563 µs | 26.0 ms |
| Ranges with mixed effects | 96 rows | 72.2270 | 72.2270 | < 0.0001% | Simulate uncertainty | 629 µs | 34.6 ms |
| Samples with mixed effects | 96 rows | 72.2270 | 72.2270 | < 0.0001% | Simulate uncertainty | 794 µs | 27.5 ms |
Cross-validation and choosing settings
Rolling-origin cross-validation, metrics, baselines, settings search and a final holdout check on logistic models.
| Case | Input | Effect output | Python output | Largest difference | Timed step | Effect time | Python time |
|---|---|---|---|---|---|---|---|
| Cross-validation and metrics | 96 rows | 59.1345 | 59.1345 | < 0.0001% | Cross-validate | 16.6 ms | 60.2 ms |
| Cross-validation with ranges | 96 rows | 59.1345 | 59.1345 | < 0.0001% | Cross-validate with ranges | 18.5 ms | 64.8 ms |
| Choosing settings and a final holdout | 96 rows | 59.1345 | 59.1345 | < 0.0001% | Search settings | 36.8 ms | 123 ms |
| Cross-validation, eight months | 256 rows | 88.5367 | 88.5214 | 0.034% | Cross-validate | 14.2 ms | 42.2 ms |
| Cross-validation with ranges, eight months | 256 rows | 88.5367 | 88.5214 | 0.034% | Cross-validate with ranges | 16.1 ms | 56.8 ms |