Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DAGN: Discourse-Aware Graph Network for Logical Reasoning

About

Recent QA with logical reasoning questions requires passage-level relations among the sentences. However, current approaches still focus on sentence-level relations interacting among tokens. In this work, we explore aggregating passage-level clues for solving logical reasoning QA by using discourse-based information. We propose a discourse-aware graph network (DAGN) that reasons relying on the discourse structure of the texts. The model encodes discourse information as a graph with elementary discourse units (EDUs) and discourse relations, and learns the discourse-aware features via a graph network for downstream QA tasks. Experiments are conducted on two logical reasoning QA datasets, ReClor and LogiQA, and our proposed DAGN achieves competitive results. The source code is available at https://github.com/Eleanor-H/DAGN.

Yinya Huang, Meng Fang, Yu Cao, Liwei Wang, Xiaodan Liang• 2021

Related benchmarks

TaskDatasetResultRank
Logical reasoningLogiQA (test)
Accuracy39.32
92
Logical reasoningReClor (test)
Accuracy58.3
87
Logical reasoningLogiQA (val)
Accuracy36.87
50
Logical reasoningReClor (dev)
Accuracy0.658
46
Logical reasoningLogiQA (dev)
Accuracy36.87
40
Logical reasoningReClor Hard (test)
Accuracy44.46
37
Logical reasoningReClor Easy (test)
Accuracy76.14
28
Logical reasoningReClor v1 (test)
Accuracy58.3
23
Logical reasoningReClor (test-H)
Accuracy44.46
23
Logical reasoningReClor (test-e)
Accuracy75.91
23
Showing 10 of 22 rows

Other info

Code

Follow for update