Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation

About

Knowing the reasoning chains from knowledge to the predicted answers can help construct an explainable question answering (QA) system. Advances on QA explanation propose to explain the answers with entailment trees composed of multiple entailment steps. While current work proposes to generate entailment trees with end-to-end generative models, the steps in the generated trees are not constrained and could be unreliable. In this paper, we propose METGEN, a Module-based Entailment Tree GENeration framework that has multiple modules and a reasoning controller. Given a question and several supporting knowledge, METGEN can iteratively generate the entailment tree by conducting single-step entailment with separate modules and selecting the reasoning flow with the controller. As each module is guided to perform a specific type of entailment reasoning, the steps generated by METGEN are more reliable and valid. Experiment results on the standard benchmark show that METGEN can outperform previous state-of-the-art models with only 9% of the parameters.

Ruixin Hong, Hongming Zhang, Xintong Yu, Changshui Zhang• 2022

Related benchmarks

TaskDatasetResultRank
Entailment tree generationEntailmentBank Task 3 (Full Unseen)
Leaves F134.8
10
Entailment tree generationEntailmentBank Task 1 (No Distractors)
Leaves F1100
6
SelectioneQASC
P@155.81
6
Entailment tree generationEntailmentBank Task 2 (Distractors)
Leaves F183.7
6
SelectioneOBQA
P@10.7489
6
Entailment tree generationEntailmentBank (test)
Leaves F134.8
5
Showing 6 of 6 rows

Other info

Follow for update