ChessMimic: Per-Rating Transformer Models for Human Move, Clock, and Outcome Prediction in Online Blitz Chess
About
We present ChessMimic, a system of three small encoder-only transformers - for move, thinking-time, and outcome prediction - conditioned on the position, recent move history, player rating, and clock state. We fit a separate instance of each model per 100-Elo rating band, trading parameter efficiency for sharper per-skill calibration. On a held-out month-wide slice of Lichess Rated Blitz games ChessMimic's human move prediction accuracy outperforms Maia-2 in every Elo band. Compared to Maia-3, our 9M parameter model's accuracy sits between Maia-3-5M and Maia-3-23M without the additional complexity of Geometric Attention Bias. In addition to the move matching model, we also train a game outcome model that conditions not only on the position, but also player ratings, time control, and remaining clock times. The outcome model achieves an AUC of 0.78 out of sample, beating Maia-2 as well as logistic regressions based on material, ratings, and clock time. Finally, we train a clock model that predicts human thinking times. The clock model provides a usable but non-SOTA per-ply think-time signal under ALLIE-style filters (Pearson r = 0.41, Spearman rho = 0.50, MAE 4.10 s, against ALLIE's reported r = 0.70), with the residual gap concentrated in per-position bucket sharpness rather than bucket-marginal calibration. A public demo is at 1e4.ai and we release code, per-band weights, and the C++ data-filter pipeline code in GitHub.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Tactical Move Prediction | Lichess tactical puzzles v18 (reservoir sample (n=74,424)) | Top-1 Accuracy76.5 | 42 | |
| Chess Outcome Prediction | Lichess sample April 2026 (month-wide slice) | Brier Score0.174 | 28 | |
| Win Prediction | Lichess Blitz April 2026 (held-out slice) | Predicted Expected Score92.3 | 10 | |
| Outcome Prediction | Lichess April 2026 (held-out slice) | Brier Score0.1837 | 7 | |
| Move prediction | bot-filtered blitz sample Rating Band 0-1000 April 2026 (test) | Top-1 Accuracy51.11 | 5 | |
| Move prediction | bot-filtered blitz sample (Rating Band 1000-1100) April 2026 (test) | Top-1 Move Accuracy53.16 | 5 | |
| Move prediction | bot-filtered blitz sample Rating Band 1100-1200 April 2026 (test) | Top-1 Accuracy53.97 | 5 | |
| Move prediction | bot-filtered blitz sample Rating Band 1200-1300 April 2026 (test) | Top-1 Accuracy54.6 | 5 | |
| Move prediction | bot-filtered blitz sample Rating Band 1300-1400 April 2026 (test) | Top-1 Accuracy54.92 | 5 | |
| Move prediction | bot-filtered blitz sample Rating Band 1400-1500 April 2026 (test) | Top-1 Accuracy55.33 | 5 |