Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ChessMimic: Per-Rating Transformer Models for Human Move, Clock, and Outcome Prediction in Online Blitz Chess

About

We present ChessMimic, a system of three small encoder-only transformers - for move, thinking-time, and outcome prediction - conditioned on the position, recent move history, player rating, and clock state. We fit a separate instance of each model per 100-Elo rating band, trading parameter efficiency for sharper per-skill calibration. On a held-out month-wide slice of Lichess Rated Blitz games ChessMimic's human move prediction accuracy outperforms Maia-2 in every Elo band. Compared to Maia-3, our 9M parameter model's accuracy sits between Maia-3-5M and Maia-3-23M without the additional complexity of Geometric Attention Bias. In addition to the move matching model, we also train a game outcome model that conditions not only on the position, but also player ratings, time control, and remaining clock times. The outcome model achieves an AUC of 0.78 out of sample, beating Maia-2 as well as logistic regressions based on material, ratings, and clock time. Finally, we train a clock model that predicts human thinking times. The clock model provides a usable but non-SOTA per-ply think-time signal under ALLIE-style filters (Pearson r = 0.41, Spearman rho = 0.50, MAE 4.10 s, against ALLIE's reported r = 0.70), with the residual gap concentrated in per-position bucket sharpness rather than bucket-marginal calibration. A public demo is at 1e4.ai and we release code, per-band weights, and the C++ data-filter pipeline code in GitHub.

Thomas Johnson• 2026

Related benchmarks

TaskDatasetResultRank
Tactical Move PredictionLichess tactical puzzles v18 (reservoir sample (n=74,424))
Top-1 Accuracy76.5
42
Chess Outcome PredictionLichess sample April 2026 (month-wide slice)
Brier Score0.174
28
Win PredictionLichess Blitz April 2026 (held-out slice)
Predicted Expected Score92.3
10
Outcome PredictionLichess April 2026 (held-out slice)
Brier Score0.1837
7
Move predictionbot-filtered blitz sample Rating Band 0-1000 April 2026 (test)
Top-1 Accuracy51.11
5
Move predictionbot-filtered blitz sample (Rating Band 1000-1100) April 2026 (test)
Top-1 Move Accuracy53.16
5
Move predictionbot-filtered blitz sample Rating Band 1100-1200 April 2026 (test)
Top-1 Accuracy53.97
5
Move predictionbot-filtered blitz sample Rating Band 1200-1300 April 2026 (test)
Top-1 Accuracy54.6
5
Move predictionbot-filtered blitz sample Rating Band 1300-1400 April 2026 (test)
Top-1 Accuracy54.92
5
Move predictionbot-filtered blitz sample Rating Band 1400-1500 April 2026 (test)
Top-1 Accuracy55.33
5
Showing 10 of 26 rows

Other info

Follow for update