Our new X account is live! Follow @wizwand_team for updates

Story Generation

Benchmarks

Dataset Name	SOTA Method	Metric
Native Story Generation Egypt	Gemma2-9B-IT + Mango	Cultural Relevance7	27	4d ago
Native Story Generation Indonesia	Gemma2-9B-IT	Cultural Relevance8.5	27	4d ago
Native Story Generation China (native)	Gemma2-9B-IT	Cultural Relevance8.6	27	4d ago
ROC Stories (test)	MARS (default)	Pearson's r0.476	24	4d ago
Moderate dataset Novels and Scripts (test)	RecurrentGPT	Fascination74.6	12	4d ago
English Story Generation Egypt	Qwen2.5-7B-IT + CCKG	Coherence (CR)8.9	9	4d ago
English Story Generation Indonesia	Gemma2-9B-IT + CCKG	Cultural Relevance8	9	4d ago
English Story Generation China	Gemma2-9B-IT + CCKG	Coherence Rating (CR)7.8	9	4d ago
Story		Quality122.6	9	4d ago
TVSTORYGEN Fandom (test)		BLEU100	9	4d ago
TVMegaSite TVSTORYGEN (test)		BLEU Score100	9	4d ago
ROC (dev)	KID	BLEU-128.1	9	4d ago
Roc Ending	UPRISE	Rouge-L18	8	3d ago
Roc Story	Se²	Rouge-L20.4	8	3d ago
TVMegaSite TVSTORYGEN (dev)	(NN) Oracle plot + summary + oracle char. desc.	BL30.9	8	4d ago
VIST 400 albums (test)	h-attn-rank	Preference Rate70.5	6	4d ago
ConsiStory-Human 1.0 (test)	ConsiStory	CLIP-T Score35.5	5	4d ago
Story Generation Evaluation Set	IdentityStory	Text Alignment84.41	5	4d ago
ROCStories 2016	BLIP-2	Repetition Score (rep-2)24.26	5	4d ago
STORYWARS (test)	OPT-350m	Next Chapter BERTScore83.25	5	4d ago
ROC (test)	HINT	Fluency Win Rate37.5	5	4d ago
Visual Storytelling Dataset (test)	h-(gd)attn-rank	BLEU-321.02	5	4d ago
Claude-3 Story Evaluation Scripts via Dramatron (test)	MoPS-Dramatron	Fascination78.97	4	4d ago
Claude-3 Story Evaluation Novels via RecurrentGPT (test)	MoPS-RecurrentGPT	Fascination73	4	4d ago
50 premise paragraphs	Playwriting-guided Generation	Suspense Score42	3	4d ago

Showing 25 of 27 rows