Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LLM Review: Enhancing Creative Writing via Blind Peer Review Feedback

About

Large Language Models (LLMs) often struggle with creative generation, and multi-agent frameworks that improve reasoning through interaction can paradoxically hinder creativity by inducing content homogenization. We introduce LLM Review, a peer-review-inspired framework implementing Blind Peer Review: agents exchange targeted feedback while revising independently, preserving divergent creative trajectories. To enable rigorous evaluation, we propose SciFi-100, a science fiction writing dataset with a unified framework combining LLM-as-a-judge scoring, human annotation, and rule-based novelty metrics. Experiments demonstrate that LLM Review consistently outperforms multi-agent baselines, and smaller models with our framework can surpass larger single-agent models, suggesting interaction structure may substitute for model scale.

Weiyue Li, Mingxiao Song, Zhenda Shen, Dachuan Zhao, Yunfan Long, Yi Li, Yongce Li, Ruyi Yang, Mengyu Wang• 2026

Related benchmarks

TaskDatasetResultRank
Creativity EvaluationSciFi-100 LLaMA-3.2-3B 1.0 (test)
Concepts Score3.98
5
Showing 1 of 1 rows

Other info

Follow for update