Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Conflict-Resilient Multi-Agent Reasoning via Signed Graph Modeling

About

LLM-based multi-agent systems (MAS) have demonstrated strong reasoning and decision-making capabilities that consistently surpass those of single LLM agents. However, their performance often suffers from naive aggregation mechanisms that assume uniformly cooperative interactions. Upon close inspection, we observe that existing graph-based MAS frameworks (1) propagate errors when conflicting signals arise without control, and (2) lack explicit modeling of conflicting inter-agent relations as well as structural awareness, failing to identify reliable interaction patterns. To bridge this gap, we introduce SIGMA, a novel SIgned Graph-informed Multi-Agent reasoning framework that explicitly captures trust, conflict, and neutral relations among agents via a signed relational graph. Specifically, given a query, SIGMA first selects a set of relevant and diverse agents, then constructs a structured signed interaction graph with confidence-weighted edges. Reasoning proceeds through conflict-aware signed message passing, which reinforces information from trustworthy agents while suppressing conflicting signals, and terminates with a structure- and conflict-aware weighted aggregation to yield globally consistent and conflict-resilient predictions. Extensive experiments on six benchmark datasets, across multiple LLM backbones and diverse multi-agent configurations, demonstrate that SIGMA consistently outperforms state-of-the-art baselines, achieving notable gains in both accuracy and conflict-resilient performance.

Longgang He, Longzhu He, Daojing He, Chaozhuo Li• 2026

Related benchmarks

TaskDatasetResultRank
Code GenerationHumanEval (test)--
612
Mathematical ReasoningGSM8K
Accuracy (Acc)96.81
337
Code GenerationHumanEval
HumanEval Score95.22
128
Knowledge ReasoningMMLU-Pro
Accuracy91.43
120
Arithmetic ReasoningMultiArith (test)
Accuracy98.87
115
Multi-task Language UnderstandingMMLU (test)--
87
Knowledge ReasoningMMLU
MMLU Knowledge Reasoning Accuracy93.91
73
Graduate-level Science Question AnsweringGPQA
Accuracy (GPQA)54.51
72
Mathematical ReasoningGSM8K (test)
Accuracy96.23
58
Multi-task Language UnderstandingMMLUpro (test)
Accuracy95.71
36
Showing 10 of 10 rows

Other info

Follow for update