Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Strategic Doctrine Language Models (sdLM): A Learning-System Framework for Doctrinal Consistency and Geopolitical Forecasting

About

We introduce Strategic Doctrine Language Models (sdLM), a learning-system framework for multi-document strategic reasoning with doctrinal consistency constraints and calibrated uncertainty. The approach combines multi-document attention, temporal encoding, and a doctrine-consistency layer to improve long-horizon forecasting and plan plausibility while reducing severe doctrinal violations. We evaluate sdLM using (i) expert-panel scoring of strategic scenarios (N=47), (ii) doctrine consistency on 336 doctrine publications (12,847 statements), and (iii) geopolitical forecasting on 127 historical counterfactuals (1945-2020) across 12-60 month horizons. Across these benchmarks, sdLM achieves higher strategic quality and better calibration than strong general-purpose LLM baselines, and remains competitive with human experts on long-horizon judgments. We further report ablations, scaling trends, and deployment-oriented performance/latency characteristics to clarify which components drive improvements and how they translate to operational settings.

Olaf Yunus Laitinen Imanov, Taner Yilmaz, Derya Umut Kulali• 2026

Related benchmarks

TaskDatasetResultRank
Doctrine Consistency Analysis336 publications, 12,847 statements dataset
Precision91.2
5
Strategic Scenario Quality AssessmentStrategic Scenarios (47 experts)
Mean Score8.42
5
Geopolitical PredictionGeopolitical Prediction 12-month temporal horizon 1.0
Accuracy0.732
4
Geopolitical PredictionGeopolitical Prediction 24-month temporal horizon 1.0
Accuracy67.1
4
Geopolitical PredictionGeopolitical Prediction 36-month temporal horizon 1.0
Accuracy62.3
4
Geopolitical PredictionGeopolitical Prediction 60-month horizon 1.0
Accuracy58.6
4
Geopolitical PredictionGeopolitical Prediction Overall 1.0 (aggregated)
Brier Score0.176
3
Showing 7 of 7 rows

Other info

Follow for update