Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting

About

This paper explores the task of Difficulty-Controllable Question Generation (DCQG), which aims at generating questions with required difficulty levels. Previous research on this task mainly defines the difficulty of a question as whether it can be correctly answered by a Question Answering (QA) system, lacking interpretability and controllability. In our work, we redefine question difficulty as the number of inference steps required to answer it and argue that Question Generation (QG) systems should have stronger control over the logic of generated questions. To this end, we propose a novel framework that progressively increases question difficulty through step-by-step rewriting under the guidance of an extracted reasoning chain. A dataset is automatically constructed to facilitate the research, on which extensive experiments are conducted to test the performance of our method.

Yi Cheng, Siyao Li, Bang Liu, Ruihui Zhao, Sujian Li, Chenghua Lin, Yefeng Zheng• 2021

Related benchmarks

TaskDatasetResultRank
Question GenerationHotpotQA (test)
BLEU-30.2107
6
Question GenerationHuman Evaluation 2-hop questions (test)
Well-formed Rate (Yes)74
4
Question GenerationHuman Evaluation 1-hop questions (test)
Well-formed: Yes46
2
Question AnsweringDP-Graph generated QA dataset (test)--
2
Question AnsweringGPT2 generated QA dataset (test)--
2
Question AnsweringOurs 2-hop generated QA dataset (test)--
2
Question AnsweringOurs 1-hop generated QA dataset (test)--
2
Showing 7 of 7 rows

Other info

Code

Follow for update