Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension

About

Recent machine reading comprehension datasets such as ReClor and LogiQA require performing logical reasoning over text. Conventional neural models are insufficient for logical reasoning, while symbolic reasoners cannot directly apply to text. To meet the challenge, we present a neural-symbolic approach which, to predict an answer, passes messages over a graph representing logical relations between text units. It incorporates an adaptive logic graph network (AdaLoGN) which adaptively infers logical relations to extend the graph and, essentially, realizes mutual and iterative reinforcement between neural and symbolic reasoning. We also implement a novel subgraph-to-node message passing mechanism to enhance context-option interaction for answering multiple-choice questions. Our approach shows promising results on ReClor and LogiQA.

Xiao Li, Gong Cheng, Ziheng Chen, Yawei Sun, Yuzhong Qu• 2022

Related benchmarks

TaskDatasetResultRank
Logical reasoningLogiQA (test)
Accuracy40.71
92
Logical reasoningReClor (test)
Accuracy60.2
87
Logical reasoningLogiQA (val)
Accuracy39.94
50
Logical reasoningReClor (dev)
Accuracy0.652
46
Logical reasoningLogiQA (dev)
Accuracy39.94
40
Logical reasoningReClor Hard (test)
Accuracy45.18
37
Logical reasoningReClor Easy (test)
Accuracy79.32
28
Logical reasoningReClor (test-e)
Accuracy79.32
23
Logical reasoningReClor (test-H)
Accuracy45.18
23
Logical reasoningReClor (val)
Accuracy (ReClor val)65.2
15
Showing 10 of 10 rows

Other info

Code

Follow for update