Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MISID: A Multimodal Multi-turn Dataset for Complex Intent Recognition in Strategic Deception Games

About

Understanding human intent in complex multi-turn interactions remains a fundamental challenge in human-computer interaction and behavioral analysis. While existing intent recognition datasets focus mainly on single utterances or simple dialogues, real-world scenarios often involve sophisticated strategic interactions where participants must maintain complex deceptive narratives over extended periods. To address this gap, we introduce MISID, a comprehensive multimodal, multi-turn, and multi-participant benchmark for intent recognition. Sourced from high-stakes social strategy games, MISID features a fine-grained, two-tier multi-dimensional annotation scheme tailored for long-context discourse analysis and evidence-based causal tracking. Our systematic evaluation of state-of-the-art Multimodal Large Language Models (MLLMs) on MISID reveals critical deficiencies in complex scenarios, including text-prior visual hallucination, impaired cross-modal synergy, and limited capacity in chaining causal cues. Consequently, we propose FRACTAM as a baseline framework. Using a ``Decouple-Anchor-Reason'' paradigm, FRACTAM reduces text bias by extracting pure unimodal factual representations, employs two-stage retrieval for long-range factual anchoring, and constructs explicit cross-modal evidence chains. Extensive experiments demonstrate that FRACTAM enhances mainstream models' performance in complex strategic tasks, improving hidden intent detection and inference while maintaining robust perceptual accuracy. Our dataset is available at https://naislab.cn/datasets/MISID.

Shufang Lin, Muyang Chen, Xiabing Zhou, Rongrong Zhang, Dayou Zhang, Fangxin Wang• 2026

Related benchmarks

TaskDatasetResultRank
Emotion AnalysisMISID
Emotion State Accuracy90.75
29
Hidden Intent InferenceMISID
Hidden Intent Inference Score53.27
29
Identity JudgmentMISID
Identity Judgment Accuracy72.22
29
Lie DetectionMISID
Lie Detection Accuracy61.54
29
Subjectivity AnalysisMISID
Subjectivity Accuracy94.85
29
Showing 5 of 5 rows

Other info

Follow for update