Pick-a-Pic
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text-to-Image Generation | Pick-a-Pic | PickScore22.51 | 47 | |
| Text-to-image generation | Pick-a-Pic v2 (test) | PickScore92.9 | 42 | |
| Text-to-Image Generation | Pick-a-Pic (test) | PickScore87 | 26 | |
| Text-to-Image Generation | Pick-a-Pic 1K prompts v1 | ImageReward1.28 | 20 | |
| Text-to-Image Generation | Pick-a-Pic (val) | PickScore24.9 | 20 | |
| Text-to-Image Generation Evaluation | Pick-a-Pic unique v2 (val) | PickScore22.59 | 13 | |
| Text-to-Image Alignment | Pick-a-Pic (test) | Pick Score2,388 | 10 | |
| Affective image generation | Pick-a-Pic | HPSV231.08 | 9 | |
| Automatic preference evaluation | Pick-a-Pic v2 (test) | Aesthetic Score Median6.0372 | 9 | |
| Text-to-image alignment | Pick-a-Pic V1 (test) | PickScore23.14 | 8 | |
| Preference-conditioned image generation | Pick-a-Pic processed | FID189.34 | 7 | |
| Human preference prediction | Pick-a-Pic (test) | Accuracy70.5 | 7 | |
| Text-to-Image Generation | Pick-a-Pic V2 (val) | PickScore21.27 | 5 | |
| Text-to-Image Generation | Pick-a-Pic v2 | CLIP Score32.96 | 5 | |
| Preference Discrimination | Pick-a-Pic processed | Top-1 Acc57.61 | 4 | |
| Affective image editing | Pick-a-Pic | HPSV224.65 | 4 | |
| Text-to-Image Generation | Pick-a-Pic D3 | Text Alignment0.5413 | 4 | |
| Text-to-Image Selection | Pick-a-Pic | Win Rate85.1 | 4 | |
| Text-to-Image Generation | Pick-a-Pic LPO v1 (val) | HPSv20.276 | 2 | |
| Text-to-Image Generation | Pick-a-Pic SPIN-Diffusion v1 (val) | HPSv20.276 | 2 | |
| Text-to-Image Generation | Pick-a-Pic SSPO v2 (val) | HPSv20.272 | 2 | |
| Text-to-Image Generation | Pick-a-Pic PCPO v1 (val) | HPSv20.271 | 2 |
Showing 22 of 22 rows