Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Deformation-based In-Context Learning for Point Cloud Understanding

About

Recent advances in point cloud In-Context Learning (ICL) have demonstrated strong multitask capabilities. Existing approaches typically adopt a Masked Point Modeling (MPM)-based paradigm for point cloud ICL. However, MPM-based methods directly predict the target point cloud from masked tokens without leveraging geometric priors, requiring the model to infer spatial structure and geometric details solely from token-level correlations via transformers. Additionally, these methods suffer from a training-inference objective mismatch, as the model learns to predict the target point cloud using target-side information that is unavailable at inference time. To address these challenges, we propose DeformPIC, a deformation-based framework for point cloud ICL. Unlike existing approaches that rely on masked reconstruction, DeformPIC learns to deform the query point cloud under task-specific guidance from prompts, enabling explicit geometric reasoning and consistent objectives. Extensive experiments demonstrate that DeformPIC consistently outperforms previous state-of-the-art methods, achieving reductions of 1.6, 1.8, and 4.7 points in average Chamfer Distance on reconstruction, denoising, and registration tasks, respectively. Furthermore, we introduce a new out-of-domain benchmark to evaluate generalization across unseen data distributions, where DeformPIC achieves state-of-the-art performance.

Chengxing Lin, Jinhong Deng, Yinjie Lei, Wen Li• 2026

Related benchmarks

TaskDatasetResultRank
ReconstructionShapeNet In-Context
CD L12.2
59
DenoisingShapeNet In-Context
L1 CD Error2.8
59
RegistrationShapeNet In-Context
L1 CD Error (x1000)1.90e+3
47
Point Cloud ReconstructionScanObjectNN target domain (Evaluation)
Chamfer Distance (CD)0.004
19
Part SegmentationShapeNet In-Context 1.0 (test)
mIoU83.9
18
Point Cloud DenoisingModelNet40 In-Context
Chamfer Distance (x1000)3.9
7
Point Cloud DenoisingScanObjectNN In-Context
Chamfer Distance (x1000)5
7
Point Cloud ReconstructionModelNet40 In-Context
Chamfer Distance0.0034
7
Point cloud registrationModelNet40 In-Context
Chamfer Distance0.0023
7
Point cloud registrationScanObjectNN In-Context
Chamfer Distance0.002
7
Showing 10 of 15 rows

Other info

Follow for update