DrawBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text-to-image generation | DrawBench | Latency (s)5.5 | 48 | |
| Text-to-Image Generation | DrawBench | Pick Score23.26 | 40 | |
| Text-to-image generation | Short-DrawBench 1k prompts Stable Diffusion v1.5 base (test) | R1 Score0.43 | 35 | |
| Text-to-Image Generation | DrawBench | HPS v230.55 | 33 | |
| Text-to-Image Generation | DrawBench | PickScore23.8 | 32 | |
| Text-to-Image Generation | DrawBench | HPSv231.58 | 27 | |
| Text-to-Image Generation | DrawBench | Aes.6.89 | 25 | |
| Text-to-Image Generation | DrawBench | HPS0.3052 | 22 | |
| text-to-image generation | DrawBench v1.0 (test) | Latency (s)2.55 | 22 | |
| Text-to-Image Generation | DrawBench | ImageReward1.3712 | 19 | |
| Text-to-Image Generation | Drawbench | HPSV2.131.67 | 19 | |
| Text-to-image synthesis evaluation (Human Correlation - Overall) | DrawBench | Kendall's Tau0.223 | 19 | |
| Text-to-Image Generation | DrawBench | VQAScore0.901 | 18 | |
| Text-to-Image Generation | DrawBench Visual Text Rendering | PickScore23.68 | 17 | |
| Text-to-Image Generation | DrawBench | ImageReward1.22 | 14 | |
| Text-to-Image Generation | DrawBench | HPS29.53 | 14 | |
| Text-to-Image Generation | DrawBench FLUX.1 (dev) | IR0.9655 | 13 | |
| Text-to-Image Generation | DrawBench | HPS0.2996 | 12 | |
| Text-to-Image Generation | DrawBench 1.0 (test) | InBSim0.707 | 12 | |
| Text-to-Image | DrawBench | HPS v230.58 | 12 | |
| Text-to-Image Generation | DrawBench | VS8.847 | 12 | |
| Text-to-Image Generation | DrawBench | PickScore24.05 | 12 | |
| Text-to-Image Generation | DrawBench | HPSv228.71 | 11 | |
| Image Generation | DrawBench | Aesthetic Score5.45 | 10 | |
| Text-to-Image Generation | DrawBench evaluated with Stable Diffusion 3.5 medium 1.0 (test) | IR0.97 | 10 |
Showing 25 of 68 rows