Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation

About

A story premise succinctly defines a story's main idea, foundation, and trajectory. It serves as the initial trigger in automatic story generation. Existing sources of story premises are limited by a lack of diversity, uneven quality, and high costs that make them difficult to scale. In response, we introduce Modular Story Premise Synthesis (MoPS) which breaks down story premises into modules like background and persona for automated design and generation. MoPS consists of three phases: (1) Precollect a consistent set of candidates for each module to form a nested dictionary. (2) Extract a key path from the nested dictionary as the premise design. (3) Instruct an LLM to integrate the design into a coherent premise sentence. Thorough evaluations demonstrate that our synthesized premises excel in diversity, fascination, completeness, and originality compared to those induced from large language models and captured from public story datasets. Similarly, the extended novels and scripts generated from our premises also exhibit higher quality. In supplementary materials, we provide the MoPS code suite, along with 7.6k generated premises and 1k extended stories. Code: https://github.com/GAIR-NLP/MoPS.

Yan Ma, Yu Qiao, Pengfei Liu• 2024

Related benchmarks

TaskDatasetResultRank
Story GenerationModerate dataset Novels and Scripts (test)
Fascination74.6
12
Story Premise Diversity EvaluationStory Premise Human Evaluation Set 600 premises 1.0 (test)
Average Score3.875
6
Story Premise GenerationStory Premises moderate
Breadth3.55e+3
6
Script GenerationScriptBench (test)
AI Rating - Format Compliance3.2
5
Story GenerationClaude-3 Story Evaluation Novels via RecurrentGPT (test)
Fascination73
4
Story GenerationClaude-3 Story Evaluation Scripts via Dramatron (test)
Fascination78.97
4
Story Premise GenerationStory Premises
Fascination3.4125
4
Story Premise EvaluationStory Premises 100 samples 1.0 (test)
Fascination73.65
4
Story Generation EvaluationROCStories (test)
Fascination0.6909
2
Story Generation EvaluationWritingPrompts (WP) (test)
Fascination73.88
2
Showing 10 of 10 rows

Other info

Code

Follow for update