Controllable Neural Dialogue Summarization with Personal Named Entity Planning
About
In this paper, we propose a controllable neural generation framework that can flexibly guide dialogue summarization with personal named entity planning. The conditional sequences are modulated to decide what types of information or what perspective to focus on when forming summaries to tackle the under-constrained problem in summarization tasks. This framework supports two types of use cases: (1) Comprehensive Perspective, which is a general-purpose case with no user-preference specified, considering summary points from all conversational interlocutors and all mentioned persons; (2) Focus Perspective, positioning the summary based on a user-specified personal named entity, which could be one of the interlocutors or one of the persons mentioned in the conversation. During training, we exploit occurrence planning of personal named entities and coreference information to improve temporal coherence and to minimize hallucination in neural generation. Experimental results show that our proposed framework generates fluent and factually consistent summaries under various planning controls using both objective metrics and human evaluations.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Abstractive dialogue summarization | SamSum (test) | -- | 53 | |
| Question Generation | Molweni (test) | BLEU Score18.53 | 8 | |
| Dialogue Summarization | SAMSum In-distribution Names (test) | R227.82 | 4 | |
| Dialogue Summarization | SAMSum All-possible Names (test) | R227.5 | 4 | |
| Reading Comprehension | Molweni (test) | BLEU27.09 | 4 | |
| Reading Comprehension | Molweni Reading Comprehension In-distribution Names (test) | BLEU27.07 | 4 | |
| Reading Comprehension | Molweni Reading Comprehension All-possible Names (test) | BLEU27.12 | 4 | |
| Question Generation | Molweni In-distribution Names | BLEU17.89 | 4 | |
| Question Generation | Molweni All-possible Names | BLEU17.81 | 4 |