MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation
About
A story premise succinctly defines a story's main idea, foundation, and trajectory. It serves as the initial trigger in automatic story generation. Existing sources of story premises are limited by a lack of diversity, uneven quality, and high costs that make them difficult to scale. In response, we introduce Modular Story Premise Synthesis (MoPS) which breaks down story premises into modules like background and persona for automated design and generation. MoPS consists of three phases: (1) Precollect a consistent set of candidates for each module to form a nested dictionary. (2) Extract a key path from the nested dictionary as the premise design. (3) Instruct an LLM to integrate the design into a coherent premise sentence. Thorough evaluations demonstrate that our synthesized premises excel in diversity, fascination, completeness, and originality compared to those induced from large language models and captured from public story datasets. Similarly, the extended novels and scripts generated from our premises also exhibit higher quality. In supplementary materials, we provide the MoPS code suite, along with 7.6k generated premises and 1k extended stories. Code: https://github.com/GAIR-NLP/MoPS.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Story Generation | Moderate dataset Novels and Scripts (test) | Fascination74.6 | 12 | |
| Story Premise Diversity Evaluation | Story Premise Human Evaluation Set 600 premises 1.0 (test) | Average Score3.875 | 6 | |
| Story Premise Generation | Story Premises moderate | Breadth3.55e+3 | 6 | |
| Script Generation | ScriptBench (test) | AI Rating - Format Compliance3.2 | 5 | |
| Story Generation | Claude-3 Story Evaluation Novels via RecurrentGPT (test) | Fascination73 | 4 | |
| Story Generation | Claude-3 Story Evaluation Scripts via Dramatron (test) | Fascination78.97 | 4 | |
| Story Premise Generation | Story Premises | Fascination3.4125 | 4 | |
| Story Premise Evaluation | Story Premises 100 samples 1.0 (test) | Fascination73.65 | 4 | |
| Story Generation Evaluation | ROCStories (test) | Fascination0.6909 | 2 | |
| Story Generation Evaluation | WritingPrompts (WP) (test) | Fascination73.88 | 2 |