PIE-Bench

Benchmarks

Task Name	Dataset Name	SOTA Result
Image Editing	PIE-Bench	PSNR36.02	257
Image Editing	PIE-Bench (test)	PSNR33.45	55
Text-guided image editing	PIE-Bench	CLIP Similarity (Whole)29.78	40
Image Editing	PIE-Bench 1.0 (test)	PSNR30.21	22
Image Editing	PIE-Bench Large Edits (random images (140 images))	CLIP Score25.11	20
Image Semantic Editing	PIE-Bench (test)	PSNR37.65	18
Image Reconstruction	PIE-Bench	MSE1.27	15
Text-to-Image Generation	PIE-Bench Neg	Positive Prompt CLIP Score0.2745	14
Prompt-based Image Editing	PIE-Bench (test)	Preference Rate (Ours)78	12
Image Editing	PIE-Bench++ (test)	PSNR24.14	12
Image Inpainting	PIE-Bench (556 samples)	FID61.4	11
Continuous Image Editing	PIE-Bench	Delta Smoothness0.61	11
Image Editing	PIE-Bench Small Edits	PSNR33.25	10
Image Editing	PIE-Bench	LPIPS36.8	10
Conditional Image Reconstruction	PIE-Bench	Rank1.25	10
Image Editing	PIE-Bench 700 images	LPIPS0.1398	10
Text-guided image editing	PIE-Bench 700 images	Structure Distance0.0225	9
Image Editing	PIE-Bench v1.5 (test)	Structure Distance20.67	8
Image Editing	PIE-Bench FLUX.1 (dev)	Rank6.62	8
Text-guided image editing	PIE-Bench (test)	Structure Distance14,520	8
Text-based Image Editing	PIE-Bench++	CLIP-T26.88	7
Image Editing	PIE-Bench SD3.5-Medium	Rank2.5	6
Non-rigid image editing	PIE-Bench ChangePose	GPT-4o Score6.99	6
Image Editing	PIE-Bench++ 12	CLIP Similarity0.741	6
Image Inversion	PIE-Bench	Inference Time (s)18.22	6

Showing 25 of 31 rows