Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ChainReaction: Causal Chain-Guided Reasoning for Modular and Explainable Causal-Why Video Question Answering

About

Existing Causal-Why Video Question Answering (VideoQA) models often struggle with higher-order reasoning, relying on opaque, monolithic pipelines that entangle video understanding, causal inference, and answer generation. These black-box approaches offer limited interpretability and tend to depend on shallow heuristics. We propose a novel, modular paradigm that explicitly decouples causal reasoning from answer generation, introducing natural language causal chains as interpretable intermediate representations. Inspired by human cognitive models, these structured cause-effect sequences bridge low-level video content with high-level causal reasoning, enabling transparent and logically coherent inference. Our two-stage architecture comprises a Causal Chain Extractor (CCE) that generates causal chains from video-question pairs, and a Causal Chain-Driven Answerer (CCDA) that derives answers grounded in these chains. To address the lack of annotated reasoning traces, we introduce a scalable method for generating accurate causal chains from existing datasets. We construct human verified causal chains for 46K samples. We also propose CauCo, a new evaluation metric for causality-oriented captioning. Experiments on three large-scale benchmarks demonstrate that our approach not only outperforms state-of-the-art models, but also yields substantial gains in explainability, user trust, and generalization -- positioning the CCE as a reusable causal reasoning engine across diverse domains. Project page: https://paritoshparmar.github.io/chainreaction/

Paritosh Parmar, Eric Peh, Basura Fernando• 2025

Related benchmarks

TaskDatasetResultRank
Video Question AnsweringNEXT-QA
Overall Accuracy63.95
122
Video Question AnsweringCausal-VidQA
Accuracy76.18
21
Video Question AnsweringCausalChaos!QA
Accuracy67.65
15
Causal chain generationNeXT-QA, CausalVidQA, and CausalChaos!QA Averaged
B10.63
2
Showing 4 of 4 rows

Other info

Follow for update