SOPRAG: Multi-view Graph Experts Retrieval for Industrial Standard Operating Procedures
About
Standard Operating Procedures (SOPs) are essential for ensuring operational safety and consistency in industrial environments. However, retrieving and following these procedures presents unique challenges, such as rigid proprietary structures, condition-dependent relevance, and actionable execution requirement, which standard semantic-driven Retrieval-Augmented Generation (RAG) paradigms fail to address. Inspired by the Mixture-of-Experts (MoE) paradigm, we propose SOPRAG, a novel framework specifically designed to address the above pain points in SOP retrieval. SOPRAG replaces flat chunking with specialized Entity, Causal, and Flow graph experts to resolve industrial structural and logical complexities. To optimize and coordinate these experts, we propose a Procedure Card layer that prunes the search space to eliminate computational noise, and an LLM-Guided gating mechanism that dynamically weights these experts to align retrieval with operator intent. To address the scarcity of domain-specific data, we also introduce an automated, multi-agent workflow for benchmark construction. Extensive experiments across four industrial domains demonstrate that SOPRAG significantly outperforms strong lexical, dense, and graph-based RAG baselines in both retrieval accuracy and response utility, achieving perfect execution scores in real-world critical tasks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Retrieval | Data Center SOP Benchmark | MRR49 | 6 | |
| Retrieval | Liquid Cooling SOP Benchmark | MRR0.59 | 6 | |
| Retrieval | Building Management SOP Benchmark | MRR73 | 6 | |
| Retrieval | Airline Services SOP Benchmark | MRR0.76 | 6 | |
| Generation Quality | Data Center | Faithfulness77 | 4 | |
| Generation Quality | Liquid Cooling | Faithfulness82 | 4 | |
| Generation Quality | Building Management | Faithfulness88 | 4 | |
| Generation Quality | Airline Services | Faithfulness88 | 4 |