Pitwall: Faithful Natural-Language Race-Strategy Briefings from a Calibrated Real-Time Monte Carlo Engine
About
Live sports commentary is grounded generation under a deadline: statements concern real, named athletes, the grounding state changes every few seconds, and no reference text exists at generation time. We present Pitwall, a production system that generates natural-language Formula 1 strategy briefings in English, Spanish, and Portuguese, treating faithfulness as an architectural property rather than an aspiration: every published sentence is decomposed into typed factual claims (positions, gaps, tyres, pace, overtakes, race control) and each claim is verified against the probabilistic race state that prompted it. The same verifier gates the fine-tuning data: of 3,045 model-written targets, only the 81.9% whose every claim is state-supported are retained, the rest falling back to a provably faithful template, so the generator never sees an ungrounded target. Verification is meaningful because of the grounding substrate: a vectorized Monte Carlo engine (N=2,000 per-lap race continuations) calibrated on 126 races (2018-2024) and validated on fully held-out 2025-2026 seasons (winner-in-top-3 90.3% over 155 backtests; held-out Brier 0.0745). A recurring finding spans both halves of the system: virtues trade off and must be gated separately. In simulation, calibration-optimal is not decision-optimal; in generation, fine-tuning on richer targets buys vividness that collapses into hallucination when the grounding state is sparse -- a failure a four-base replication traces to base-model instruction adherence, not scale, and that sparse-context auditing removes from the production model. End-to-end operation -- live timing to verified trilingual briefings -- was confirmed at two consecutive live Grands Prix (Austria and Britain, 2026); at Silverstone a timestamped probability trace, committed to disk before the outcome was known, locked onto the eventual winner ten laps before the flag.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Race Outcome Prediction | F1 2018 Season | Winner Hit Rate45 | 1 | |
| Race Outcome Prediction | F1 2019 Season | Winner Hit Rate61.9 | 1 | |
| Race Outcome Prediction | F1 Season 2020 | Winner Hit Rate76.5 | 1 | |
| Race Outcome Prediction | F1 2021 Season | Winner Hit Rate72.7 | 1 | |
| Race Outcome Prediction | F1 2023 Season | Winner Hit Rate72.7 | 1 | |
| Race Outcome Prediction | F1 2024 Season | Winner Hit Rate62.5 | 1 | |
| Race Outcome Prediction | F1 2025 Season | Winner Hit Rate62.5 | 1 | |
| Race Outcome Prediction | F1 Season Partial 2026 | Winner Hit Rate60 | 1 | |
| Race Outcome Prediction | F1 Aggregate 2018-2026 | Winner Hit Rate64.5 | 1 |