Strategic Doctrine Language Models (sdLM): A Learning-System Framework for Doctrinal Consistency and Geopolitical Forecasting
About
We introduce Strategic Doctrine Language Models (sdLM), a learning-system framework for multi-document strategic reasoning with doctrinal consistency constraints and calibrated uncertainty. The approach combines multi-document attention, temporal encoding, and a doctrine-consistency layer to improve long-horizon forecasting and plan plausibility while reducing severe doctrinal violations. We evaluate sdLM using (i) expert-panel scoring of strategic scenarios (N=47), (ii) doctrine consistency on 336 doctrine publications (12,847 statements), and (iii) geopolitical forecasting on 127 historical counterfactuals (1945-2020) across 12-60 month horizons. Across these benchmarks, sdLM achieves higher strategic quality and better calibration than strong general-purpose LLM baselines, and remains competitive with human experts on long-horizon judgments. We further report ablations, scaling trends, and deployment-oriented performance/latency characteristics to clarify which components drive improvements and how they translate to operational settings.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Doctrine Consistency Analysis | 336 publications, 12,847 statements dataset | Precision91.2 | 5 | |
| Strategic Scenario Quality Assessment | Strategic Scenarios (47 experts) | Mean Score8.42 | 5 | |
| Geopolitical Prediction | Geopolitical Prediction 12-month temporal horizon 1.0 | Accuracy0.732 | 4 | |
| Geopolitical Prediction | Geopolitical Prediction 24-month temporal horizon 1.0 | Accuracy67.1 | 4 | |
| Geopolitical Prediction | Geopolitical Prediction 36-month temporal horizon 1.0 | Accuracy62.3 | 4 | |
| Geopolitical Prediction | Geopolitical Prediction 60-month horizon 1.0 | Accuracy58.6 | 4 | |
| Geopolitical Prediction | Geopolitical Prediction Overall 1.0 (aggregated) | Brier Score0.176 | 3 |