Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Question Directed Graph Attention Network for Numerical Reasoning over Text

About

Numerical reasoning over texts, such as addition, subtraction, sorting and counting, is a challenging machine reading comprehension task, since it requires both natural language understanding and arithmetic computation. To address this challenge, we propose a heterogeneous graph representation for the context of the passage and question needed for such reasoning, and design a question directed graph attention network to drive multi-step numerical reasoning over this context graph. The code link is at: https://github.com/emnlp2020qdgat/QDGAT

Kunlong Chen, Weidi Xu, Xingyi Cheng, Zou Xiaochuan, Yuyu Zhang, Le Song, Taifeng Wang, Yuan Qi, Wei Chu• 2020

Related benchmarks

TaskDatasetResultRank
Reading ComprehensionDROP (dev)
F1 Score88.1
63
Reading ComprehensionDROP (test)
F1 Score88.4
61
Reading ComprehensionDROP
F1 Score88.4
55
Question AnsweringDROP (dev)
EM84.1
10
Machine Reading ComprehensionRACENum (unsupervised)
Accuracy (RACE-M)52.53
4
Showing 5 of 5 rows

Other info

Code

Follow for update