Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DOC: Improving Long Story Coherence With Detailed Outline Control

About

We propose the Detailed Outline Control (DOC) framework for improving long-range plot coherence when automatically generating several-thousand-word-long stories. DOC consists of two complementary components: a detailed outliner and a detailed controller. The detailed outliner creates a more detailed, hierarchically structured outline, shifting creative burden from the main drafting procedure to the planning stage. The detailed controller ensures the more detailed outline is still respected during generation by controlling story passages to align with outline details. In human evaluations of automatically generated stories, DOC substantially outperforms a strong Re3 baseline (Yang et al., 2022) on plot coherence (22.5% absolute gain), outline relevance (28.2%), and interestingness (20.7%). Humans also judged DOC to be much more controllable in an interactive generation setting.

Kevin Yang, Dan Klein, Nanyun Peng, Yuandong Tian• 2022

Related benchmarks

TaskDatasetResultRank
Storyline GenerationNarrative Generation Storyline
Narrative Score48
18
Script GenerationNarrative Generation Dataset Script
Narrative Structure Score22
18
Creativity Context GenerationCreaTE
Coherence49.14
11
Context GenerationCreaTE
ROUGE-118.24
11
Novel Generation10 novels of different genres medium-length ~4k words (test)
Relevance40
8
Long Novel Generation10 Novels of Different Genres (Long ~10k words)
Relevance15.63
8
Script GenerationMulti-genre Script Dataset (test)
Word Count1.03e+4
4
Showing 7 of 7 rows

Other info

Follow for update