Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Learning Disentangled Representations for Perceptual Point Cloud Quality Assessment via Mutual Information Minimization

About

No-Reference Point Cloud Quality Assessment (NR-PCQA) aims to objectively assess the human perceptual quality of point clouds without relying on pristine-quality point clouds for reference. It is becoming increasingly significant with the rapid advancement of immersive media applications such as virtual reality (VR) and augmented reality (AR). However, current NR-PCQA models attempt to indiscriminately learn point cloud content and distortion representations within a single network, overlooking their distinct contributions to quality information. To address this issue, we propose DisPA, a novel disentangled representation learning framework for NR-PCQA. The framework trains a dual-branch disentanglement network to minimize mutual information (MI) between representations of point cloud content and distortion. Specifically, to fully disentangle representations, the two branches adopt different philosophies: the content-aware encoder is pretrained by a masked auto-encoding strategy, which can allow the encoder to capture semantic information from rendered images of distorted point clouds; the distortion-aware encoder takes a mini-patch map as input, which forces the encoder to focus on low-level distortion patterns. Furthermore, we utilize an MI estimator to estimate the tight upper bound of the actual MI and further minimize it to achieve explicit representation disentanglement. Extensive experimental results demonstrate that DisPA outperforms state-of-the-art methods on multiple PCQA datasets.

Ziyu Shan, Yujie Zhang, Yipeng Liu, Yiling Xu• 2024

Related benchmarks

TaskDatasetResultRank
Point Cloud Quality AssessmentLS-PCQA (test)
PLCC0.631
44
No-Reference Point Cloud Quality AssessmentSJTU-PCQA
PLCC0.657
24
No-Reference Point Cloud Quality AssessmentWPC complete
PLCC0.535
20
Point Cloud Quality AssessmentSJTU-PCQA (5-fold cross-validation)
SROCC0.908
16
Point Cloud Quality AssessmentWPC (5-fold cross-validation)
SROCC0.788
16
Showing 5 of 5 rows

Other info

Follow for update