Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Generating Storytelling Images with Rich Chains-of-Reasoning

About

A single image can convey a compelling story through logically connected visual clues, forming Chains-of-Reasoning (CoRs). We define these semantically rich images as Storytelling Images. By conveying multi-layered information that inspires active interpretation, these images enable a wide range of applications, such as illustration and cognitive screening. Despite their potential, such images are scarce and complex to create. To address this, we introduce the Storytelling Image Generation task and propose StorytellingPainter, a two-stage pipeline combining the reasoning of Large Language Models (LLMs) with Text-to-Image (T2I) synthesis. We also develop a dedicated evaluation framework assessing semantic complexity, diversity, and text-image alignment. Furthermore, given the critical role of story generation in the task, we introduce lightweight Mini-Storytellers to bridge the performance gap between small-scale and proprietary LLMs. Experimental results demonstrate the feasibility of our approaches.

Xiujie Song, Qi Jia, Shota Watanabe, Xiaoyi Pang, Ruijie Chen, Mengyue Wu, Kenny Q. Zhu• 2025

Related benchmarks

TaskDatasetResultRank
Storytelling Image GenerationCogBench ISA (test)
Story Length (Words)459.3
34
Storytelling Image GenerationGPT-image quality: medium 1.0
Success Rate1
17
Showing 2 of 2 rows

Other info

Follow for update