TDA-RC: Task-Driven Alignment for Knowledge-Based Reasoning Chains in Large Language Models
About
Enhancing the reasoning capability of large language models (LLMs) remains a core challenge in natural language processing. The Chain-of-Thought (CoT) paradigm dominates practical applications for its single-round efficiency, yet its reasoning chains often exhibit logical gaps. While multi-round paradigms like Graph-of-Thoughts (GoT), Tree-of-Thoughts (ToT), and Atom of Thought (AoT) achieve strong performance and reveal effective reasoning structures, their high cost limits practical use. To address this problem, this paper proposes a topology-based method for optimizing reasoning chains. The framework embeds essential topological patterns of effective reasoning into the lightweight CoT paradigm. Using persistent homology, we map CoT, ToT, and GoT into a unified topological space to quantify their structural features. On this basis, we design a unified optimization system: a Topological Optimization Agent diagnoses deviations in CoT chains from desirable topological characteristics and simultaneously generates targeted strategies to repair these structural deficiencies. Compared with multi-round reasoning methods like ToT and GoT, experiments on multiple datasets show that our approach offers a superior balance between reasoning accuracy and efficiency, showcasing a practical solution to ``single-round generation with multi-round intelligence''.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Logical reasoning | BBH | Accuracy82.9 | 201 | |
| Mathematical Reasoning | OlympiadBench | Accuracy12.8 | 81 | |
| Grade School Math Reasoning | GSM8K | Accuracy (GSM8K)94.4 | 77 | |
| General Knowledge Reasoning | MMLU CF | Accuracy73.2 | 55 | |
| Long-context Reasoning | LongBench | Accuracy (LongBench)59.5 | 45 | |
| Grade School Math Word Problems | GSM8K | Accuracy0.944 | 42 | |
| Multi-hop Reasoning | MuSiQue | Accuracy37.9 | 27 | |
| Multi-hop Question Answering | MuSiQue | Accuracy37.9 | 24 | |
| Advanced Mathematical Reasoning | OlympiadBench | Accuracy12.8 | 18 | |
| General Reasoning | BBH | Accuracy82.9 | 18 |