Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PR-IQA: Partial-Reference Image Quality Assessment for Diffusion-Based Novel View Synthesis

About

Diffusion models are promising for sparse-view novel view synthesis (NVS), as they can generate pseudo-ground-truth views to aid 3D reconstruction pipelines like 3D Gaussian Splatting (3DGS). However, these synthesized images often contain photometric and geometric inconsistencies, and their direct use for supervision can impair reconstruction. To address this, we propose Partial-Reference Image Quality Assessment (PR-IQA), a framework that evaluates diffusion-generated views using reference images from different poses, eliminating the need for ground truth. PR-IQA first computes a geometrically consistent partial quality map in overlapping regions. It then performs quality completion to inpaint this partial map into a dense, full-image map. This completion is achieved via a cross-attention mechanism that incorporates reference-view context, ensuring cross-view consistency and enabling thorough quality assessment. When integrated into a diffusion-augmented 3DGS pipeline, PR-IQA restricts supervision to high-confidence regions identified by its quality maps. Experiments demonstrate that PR-IQA outperforms existing IQA methods, achieving full-reference-level accuracy without ground-truth supervision. Thus, our quality-aware 3DGS approach more effectively filters inconsistencies, producing superior 3D reconstructions and NVS results. The project page is available at https://kakaomacao.github.io/pr-iqa-project-page/.

Inseong Choi, Siwoo Lee, Seung-Hun Nam, Soohwan Song• 2026

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisTanks&Temples (test)
PSNR16.24
289
Novel View SynthesisMip-NeRF 360 (test)
PSNR16.76
199
Image Quality Assessment CorrelationRealEstate10K
PLCC0.632
52
Image Quality Assessment CorrelationMip-NeRF 360
PLCC0.555
39
Image Quality Assessment CorrelationTanks&Temples
PLCC0.625
26
Image Quality AssessmentTanks&Temples
PLCC0.401
26
Image Quality AssessmentMip-NeRF 360
PLCC0.28
13
Image Quality AssessmentMip-NeRF 360 GEN3C
DINOv2 PLCC0.368
6
Image Quality AssessmentMip-NeRF SEVA
DINOv2 PLCC0.358
6
Image Quality AssessmentTanks and Temples SEVA
DINOv2 PLCC0.418
6
Showing 10 of 10 rows

Other info

Follow for update