PIE-Bench

Benchmarks

Task Name	Dataset Name	SOTA Result
Image Editing	PIE-Bench	PSNR36.02	116
Image Editing	PIE-Bench (test)	PSNR33.45	46
Image Editing	PIE-Bench 1.0 (test)	PSNR30.21	22
Image Semantic Editing	PIE-Bench (test)	PSNR37.65	18
Image Inpainting	PIE-Bench (556 samples)	FID61.4	11
Image Editing	PIE-Bench 700 images	LPIPS0.1398	10
Text-guided image editing	PIE-Bench (test)	Structure Distance14,520	8
Text-based Image Editing	PIE-Bench++	CLIP-T26.88	7
Non-rigid image editing	PIE-Bench ChangePose	GPT-4o Score6.99	6
Image Editing	PIE-Bench++ 12	CLIP Similarity0.741	6
Continuous Image Editing	PIE-Bench	Delta Smoothness0.61	6
Image Inversion	PIE-Bench	Inference Time (s)18.22	6
Object Surface Alteration (Material/Color)	PIE-Bench	Structure Distance0.0598	5
Content Replacement (Object/Background)	PIE-Bench	NIMA5.352	5
Image Editing	PIE-Bench random class	Quality Score71.8	5
Image Reconstruction	PIE-Bench base model v1.4 (test)	Structure Distance2.95	5
Scene graph-based Image Editing	PIE-Bench	PSNR24.8	4

Showing 17 of 17 rows