Model · data · evidence

Research validation

See whether Quantiv forecasts beat matched benchmarks, how well the uncertainty estimates are calibrated, and whether the latest research state is publishable.

AssessmentOct 16, 2026, 08:14 ET
Performance

Does the model add information?

Historical out-of-sample results compare each admitted cohort with its matched benchmark on the same observations.

Weighted error reduction
16.8%

Lower mean absolute error than matched cohort benchmarks across the admitted horizon/cohort pairs.

Admitted cohort improvement · 8.6%–46.9%
Quantiv model5.10%
Matched cohort benchmarks6.12%
91,009holdout row-observations across 23 horizon models

83,762 matched benchmark row-observations across 30 admitted horizon/cohort pairs. Calibration uses all holdout rows; MAE uses matched rows. Events can appear at multiple horizons.

Performance by horizon
HorizonCohortCalibration rowsMatched rowsBenchmarkModel MAEBenchmark MAEImprovement50% interval80% interval
T-1Optionless5,4664,917Historical move5.17%5.77%10.5%48.5%78.3%
T-2Optionless4,1253,699Historical move5.14%5.76%10.8%50.2%78.3%
T-2Strict options1,3551,355Market straddle4.31%6.27%31.2%48.3%72.8%
T-3Strict options861861Market straddle4.25%6.26%32.0%47.2%74.3%
T-4Optionless2,5372,250Historical move5.45%6.00%9.3%49.7%78.4%
T-5Optionless3,8423,501Historical move5.30%5.81%8.7%50.0%77.7%
T-6Optionless5,9035,366Historical move5.35%5.89%9.3%49.4%78.5%
T-7Optionless6,2485,622Historical move5.28%5.87%10.0%50.5%79.6%
T-7Strict options1,9261,926Market straddle4.34%6.65%34.7%47.9%75.6%
T-10Strict options887887Market straddle4.33%6.71%35.5%46.7%76.4%
T-11Optionless2,4572,165Historical move5.48%6.00%8.6%49.2%78.7%
T-12Optionless3,7273,390Historical move5.31%5.84%9.2%49.5%78.8%
T-13Optionless5,7885,245Historical move5.34%5.91%9.7%49.4%79.1%
T-14Optionless6,2515,613Historical move5.29%5.87%9.8%49.8%78.9%
T-14Strict options1,9221,922Market straddle4.29%6.80%36.8%48.0%77.0%
T-15Optionless5,4494,893Historical move5.21%5.78%9.8%49.7%78.3%
T-15Strict options1,7961,796Market straddle4.31%6.89%37.5%47.3%75.8%
T-16Strict options1,3491,349Market straddle4.45%7.09%37.3%46.0%74.6%
T-17Strict options870870Market straddle4.43%7.31%39.5%46.3%74.0%
T-18Optionless2,4062,122Historical move5.57%6.14%9.2%48.5%78.3%
T-18Strict options652652Market straddle4.09%7.35%44.4%48.0%79.3%
T-19Optionless3,6233,294Historical move5.43%5.95%8.7%48.2%78.6%
T-20Optionless5,6605,145Historical move5.39%5.96%9.6%49.1%78.9%
T-20Strict options1,6801,680Market straddle4.49%7.55%40.6%46.4%75.6%
T-21Strict options1,8541,854Market straddle4.37%7.60%42.5%45.9%75.9%
T-22Optionless5,5144,959Historical move5.18%5.75%10.0%48.9%79.1%
T-23Optionless4,2453,813Historical move5.16%5.75%10.3%50.3%79.5%
T-23Strict options1,2801,280Market straddle4.38%7.67%42.9%46.5%74.3%
T-24Strict options784784Market straddle4.47%7.88%43.3%47.2%76.1%
T-25Strict options552552Market straddle4.19%7.89%46.9%49.3%79.0%

MAE is absolute stock-move error. This is predictive validation, not a trading-P&L claim. Historical moves are a benchmark only; future forecasts have no historical-median fallback.

Uncertainty

Calibration

Observed quantiles should land close to their nominal targets. The marker shows observed frequency; the thin line is the target.

P1013.3%
Target 10.0%
P5057.2%
Target 50.0%
P9091.4%
Target 90.0%
80% interval78.1%
Target 80.0%
Additional checks
P25 observed31.1%
P75 observed80.1%
50% interval49.0%
Publication

Can new research publish?

The last validated release and the ability to publish the next one are different states. This is the only place both are summarized.

Last validated release

Passed

This is the status of the forecast release already retained for research.

Last forecast validation: Oct 16, 2026, 07:53 ET

Next research release

Held

Awaiting eligible options data. The last validated forecast release is retained; new research publication remains blocked.

Assessment captured: Oct 16, 2026, 08:14 ET

Options evidence assessed: Snapshot 2026-09-30 is 11 market sessions behind expected 2026-10-15

Controls checked13
Exceptions0
Forecast rows638
Events638
Model safeguards

Serving model

passed
Championactive
Driftwarning
Fallbackavailable
Shadow roleschampion_evidence, previous
Data safeguards

Decision universe

failed
Event coverage63.1%
Eligible contracts57,637 / 96,562
Quarantine80,232
Duplicates0
Needs attention

Why publication is constrained

7
criticalSnapshot 2026-09-30 is 11 market sessions behind expected 2026-10-15. This is the assessed snapshot state; new research stays blocked until fresh option evidence passes controls.16
warningCalendar events fall outside the current options decision universe2,826
warningIn-universe earnings events have no decision-eligible option chain468
warningAggregate option coverage is below the model activation limit; individually eligible events may publish468
warningOne or more model horizons lack sufficient eligible option coverage105
criticalOptions evidence did not pass the latest assessed controls. latest source date 2026-09-30 is 11 market session(s) behind expected 2026-10-15.
warningLatest source quotes for retired symbols are excluded from the decision universe4

These gates affect the next research release. They do not rewrite a previously validated forecast receipt.

Method

How the result is earned

The validation process can be reduced to three checks. Technical controls remain available in the audit trail below.

01

Separate past from future

Development labels fall strictly before 2026-03-26. Reserved earnings events run from 2026-04-18 through 2026-10-14.

02

Beat matched benchmarks

Strict-options results use the market straddle; optionless results use a historical-move benchmark. Each admitted pair passes point-error, calibration and statistical controls on reserved observations.

03

Verify before publication

Bundle identity, feature schema, shadow scoring, drift controls and rollback evidence all stay tied to the model that produced the stored forecasts.

Technical audit trailEvidence behind this page
Forecast receipt3db03b17a4…cfd9e871forecasts_2026-10-15.3db03b17a45f.receipt.json
Model artifact3370619ce2…8e9aa8ceapps/ml/model_trainer.py
Forecast artifacta8a218c261…43f7aff1scripts/daily_score.py
Active bundled14dc7f2aa…c869dd1bsigned champion
Control snapshotOct 16, 2026, 08:14end_of_day_research · publication blocked
Evaluation scopeHistorical out-of-samplesealed_temporal_exact_artifact_test
Admission receipt36751a5106…6c15e7fesigned model and cohort admission
Source bundle629386dcbf…bc12c2fffrozen before reserved evaluation
Serving bundled14dc7f2aa…c869dd1b23 horizons · 30 admitted horizon/cohort pairs
Reserved panelc48c61e803…c8bb2b33Reservation fd05c255ce…9d09669a
Reserved event window2026-04-18 – 2026-10-14Earliest snapshot 2026-03-26
Development checks

4 expanding walk-forward windows with 60d validation windows and a 5d purge are development evidence. They select the model before the reserved historical evaluation and are separate from the results above.

Admission proves exclusion of reserved labels from this candidate’s fitting and selection. The exact candidate excludes reserved labels from fitting, selection, early stopping and quantile calibration. Complete point-in-time calendar revision history and historical provider delivery timestamps are not established. Prior model-family exposure to this history is not established; this is not a claim of globally untouched history. Metrics describe admitted historical head/cohort cells; aggregate summaries do not establish aggregate statistical significance or live trading performance.

Decision scope

Quantiv outputs are end-of-day research evidence. Live stock prices may update spot-derived inputs, but options, IV, Greeks and other snapshot features remain frozen. The validation page does not present executable option quotes or live-trading signals.

Read methodology →