Explainable Conversational Question Answering over Heterogeneous Sources via Iterative Graph Neural Networks
About
In conversational question answering, users express their information needs through a series of utterances with incomplete context. Typical ConvQA methods rely on a single source (a knowledge base (KB), or a text corpus, or a set of tables), thus being unable to benefit from increased answer coverage and redundancy of multiple sources. Our method EXPLAIGNN overcomes these limitations by integrating information from a mixture of sources with user-comprehensible explanations for answers. It constructs a heterogeneous graph from entities and evidence snippets retrieved from a KB, a text corpus, web tables, and infoboxes. This large graph is then iteratively reduced via graph neural networks that incorporate question-level attention, until the best answers and their explanations are distilled. Experiments show that EXPLAIGNN improves performance over state-of-the-art baselines. A user study demonstrates that derived answers are understandable by end users.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Temporal Question Answering | TIME QUESTIONS 1.0 (test) | P@152.5 | 18 | |
| Temporal Question Answering | TIQ 1.0 (test) | P@10.446 | 10 | |
| Conversational Question Answering | ConvQuestions (test) | P@10.363 | 9 | |
| Open-domain Question Answering | COMPMIX (test) | Exact Match44.2 | 9 | |
| Question Answering | COMPMIX (test) | Precision@10.442 | 8 | |
| Question Answering | CRAG (test) | P@130.3 | 6 | |
| Conversational Question Answering | ConvMix 9 (test) | P@10.406 | 5 | |
| Conversational Question Answering | CONVMIX (test) | P@133.9 | 5 |