Question Directed Graph Attention Network for Numerical Reasoning over Text
About
Numerical reasoning over texts, such as addition, subtraction, sorting and counting, is a challenging machine reading comprehension task, since it requires both natural language understanding and arithmetic computation. To address this challenge, we propose a heterogeneous graph representation for the context of the passage and question needed for such reasoning, and design a question directed graph attention network to drive multi-step numerical reasoning over this context graph. The code link is at: https://github.com/emnlp2020qdgat/QDGAT
Kunlong Chen, Weidi Xu, Xingyi Cheng, Zou Xiaochuan, Yuyu Zhang, Le Song, Taifeng Wang, Yuan Qi, Wei Chu• 2020
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Reading Comprehension | DROP (dev) | F1 Score88.1 | 63 | |
| Reading Comprehension | DROP (test) | F1 Score88.4 | 61 | |
| Reading Comprehension | DROP | F1 Score88.4 | 55 | |
| Question Answering | DROP (dev) | EM84.1 | 10 | |
| Machine Reading Comprehension | RACENum (unsupervised) | Accuracy (RACE-M)52.53 | 4 |
Showing 5 of 5 rows