AeroTherm-GPT: A Verification-Centered LLM Framework for Thermal Protection System Engineering Workflows
About
Integrating Large Language Models (LLMs) into hypersonic thermal protection system (TPS) design is bottlenecked by cascading constraint violations when generating executable simulation artifacts. General-purpose LLMs, treating generation as single-pass text completion, fail to satisfy the sequential, multi-gate constraints inherent in safety-critical engineering workflows. To address this, we propose AeroTherm-GPT, the first TPS-specialized LLM Agent, instantiated through a Constraint-Closed-Loop Generation (CCLG) framework. CCLG organizes TPS artifact generation as an iterative workflow comprising generation, validation, CDG-guided repair, execution, and audit. The Constraint Dependency Graph (CDG) encodes empirical co-resolution structure among constraint categories, directing repair toward upstream fault candidates based on lifecycle ordering priors and empirical co-resolution probabilities. This upstream-priority mechanism resolves multiple downstream violations per action, achieving a Root-Cause Fix Efficiency of 4.16 versus 1.76 for flat-checklist repair. Evaluated on HyTPS-Bench and validated against external benchmarks, AeroTherm-GPT achieves 88.7% End-to-End Success Rate (95% CI: 87.5-89.9), a gain of +12.5 pp over the matched non-CDG ablation baseline, without catastrophic forgetting on scientific reasoning and code generation tasks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Code Generation | HumanEval | Pass@186.6 | 1036 | |
| Code Generation | MBPP | Pass@175 | 159 | |
| Scientific Reasoning | GPQA Diamond | Accuracy38.9 | 48 | |
| Scientific Reasoning | MMLU STEM | Accuracy80.7 | 27 | |
| Hypersonic Thermal Protection System design and analysis | HyTPS-Bench | EESR88.7 | 21 | |
| Scientific Reasoning | SciBench | -- | 17 | |
| Code Generation | MBPP n=500 | pass@175 | 6 | |
| Hypersonic Knowledge and Programming QA | HyperKFA-Bench | Fund. Knowledge96.7 | 5 |