PIE-Bench

Benchmarks

Task Name	Dataset Name	SOTA Result
Image Editing	PIE-Bench	PSNR36.02	166
Image Editing	PIE-Bench (test)	PSNR33.45	55
Image Editing	PIE-Bench 1.0 (test)	PSNR30.21	22
Image Semantic Editing	PIE-Bench (test)	PSNR37.65	18
Image Reconstruction	PIE-Bench	MSE1.27	15
Image Inpainting	PIE-Bench (556 samples)	FID61.4	11
Conditional Image Reconstruction	PIE-Bench	Rank1.25	10
Image Editing	PIE-Bench 700 images	LPIPS0.1398	10
Text-guided image editing	PIE-Bench 700 images	Structure Distance0.0225	9
Image Editing	PIE-Bench FLUX.1 (dev)	Rank6.62	8
Text-guided image editing	PIE-Bench (test)	Structure Distance14,520	8
Text-based Image Editing	PIE-Bench++	CLIP-T26.88	7
Image Editing	PIE-Bench SD3.5-Medium	Rank2.5	6
Non-rigid image editing	PIE-Bench ChangePose	GPT-4o Score6.99	6
Image Editing	PIE-Bench++ 12	CLIP Similarity0.741	6
Continuous Image Editing	PIE-Bench	Delta Smoothness0.61	6
Image Inversion	PIE-Bench	Inference Time (s)18.22	6
General Image Editing	PIE-Bench excluding Add/Remove	CLIP-dir0.371	5
Object Surface Alteration (Material/Color)	PIE-Bench	Structure Distance0.0598	5
Content Replacement (Object/Background)	PIE-Bench	NIMA5.352	5
Image Editing	PIE-Bench random class	Quality Score71.8	5
Image Reconstruction	PIE-Bench base model v1.4 (test)	Structure Distance2.95	5
Scene graph-based Image Editing	PIE-Bench	PSNR24.8	4

Showing 23 of 23 rows