Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction

About

Solving math word problems requires deductive reasoning over the quantities in the text. Various recent research efforts mostly relied on sequence-to-sequence or sequence-to-tree models to generate mathematical expressions without explicitly performing relational reasoning between quantities in the given context. While empirically effective, such approaches typically do not provide explanations for the generated expressions. In this work, we view the task as a complex relation extraction problem, proposing a novel approach that presents explainable deductive reasoning steps to iteratively construct target expressions, where each step involves a primitive operation over two quantities defining their relation. Through extensive experiments on four benchmark datasets, we show that the proposed model significantly outperforms existing strong baselines. We further demonstrate that the deductive procedure not only presents more explainable steps but also enables us to make more accurate predictions on questions that require more complex reasoning.

Zhanming Jie, Jierui Li, Wei Lu• 2022

Related benchmarks

TaskDatasetResultRank
Mathematical ReasoningSVAMP (test)
Accuracy45
233
Math Word Problem SolvingMath23K (test)
Accuracy85.4
73
Math Word Problem SolvingMath23K (5-fold cross-val)
Accuracy83.3
56
Math Word Problem SolvingMathQA (test)
Accuracy78.6
34
Mathematical Equation GenerationMAWPS (5-fold cross-validation)
Accuracy (5-fold)92.2
23
Math Word Problem SolvingMAWPS (5-fold cross val)
Accuracy92.2
21
Math Word Problem SolvingSVAMP English (test)
Accuracy51.6
20
Math ReasoningASDiv A (test)
Accuracy89.1
14
Math Word Problem SolvingMAWPS English (test)
Accuracy92.6
10
Arithmetic ReasoningMAWPS (5-fold cross val)
Accuracy92
10
Showing 10 of 15 rows

Other info

Follow for update