Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GenClaw: Code-Driven Agentic Image Generation

About

Image generation models have evolved from text-conditioned pixel synthesis toward multimodal agents endowed with visual comprehension and tool invocation capabilities. Yet, existing agents remain at the mercy of underlying black-box image models. Their workflow is trapped in a repetitive cycle of prompt rewriting for generation refinement, leaving them with no mechanism to directly manipulate the canvas. In essence, the potential of LLMs to serve as a genuine "brush" for precise visual construction remains largely untapped. In this paper, we propose GenClaw, a code-driven agentic image generation paradigm that empowers the agent to create like a human artist: first conceptualizing, then sketching, and finally coloring. Specifically, the agent first constructs the conceptual knowledge and context through search and reasoning. It then utilizes code (e.g., SVG, HTML, ThreeJS) to render executable visual sketches. Finally, it employs an image generation model to supplement textures, materials, and photorealism. In this workflow, code serves as a controllable intermediate canvas bridging linguistic reasoning and pixel synthesis, seamlessly integrating programmatic logic with the visual expressiveness of generative models. By transforming image generation from a black-box paradigm into a staged process akin to authentic human creation, GenClaw offers a step toward for highly controllable and interpretable visual generation systems.

Junyan Ye, Jun He, Zilong Huang, Dongzhi Jiang, Xuan Yang, Rui Chen, Weijia Li• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-Image GenerationGenEval++
Color Accuracy87.5
75
Image GenerationMind-Bench
Knowledge (WK)0.64
42
Text RenderingLongText-Bench Chinese
Score0.988
27
Text RenderingLongText-Bench English
Score0.989
27
Image EditingImgEdit
VLM-Score4.29
8
Showing 5 of 5 rows

Other info

GitHub

Follow for update