Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding
About
While recent Transformer and Mamba architectures have advanced point cloud representation learning, they are typically developed for single-task or single-domain settings. Directly applying them to multi-task domain generalization (DG) leads to degraded performance. Transformers effectively model global dependencies but suffer from quadratic attention cost and lack explicit structural ordering, whereas Mamba offers linear-time recurrence yet often depends on coordinate-driven serialization, which is sensitive to viewpoint changes and missing regions, causing structural drift and unstable sequential modeling. In this paper, we propose Structure-Aware Domain Generalization (SADG), a Mamba-based In-Context Learning framework that preserves structural hierarchy across domains and tasks. We design structure-aware serialization (SAS) that generates transformation-invariant sequences using centroid-based topology and geodesic curvature continuity. We further devise hierarchical domain-aware modeling (HDM) that stabilizes cross-domain reasoning by consolidating intra-domain structure and fusing inter-domain relations. At test time, we introduce a lightweight spectral graph alignment (SGA) that shifts target features toward source prototypes in the spectral domain without updating model parameters, ensuring structure-preserving test-time feature shifting. In addition, we introduce MP3DObject, a real-scan object dataset for multi-task DG evaluation. Comprehensive experiments demonstrate that the proposed approach improves structural fidelity and consistently outperforms state-of-the-art methods across multiple tasks including reconstruction, denoising, and registration.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Point Cloud Reconstruction | ModelNet40 (test) | CD5.99 | 24 | |
| Point Cloud Reconstruction | ScanObjectNN target domain (Evaluation) | Chamfer Distance (CD)4.29 | 19 | |
| Denoising | ModelNet40 | -- | 19 | |
| Point Cloud Denoising | ShapeNet (test) | Chamfer Distance (CD)9.34 | 12 | |
| Point Cloud Denoising | ScanNet target domain (Evaluation) | Chamfer Distance (CD)7.67 | 12 | |
| Point Cloud Denoising | ScanObjectNN target domain (Evaluation) | Chamfer Distance (CD)9.84 | 12 | |
| Point Cloud Denoising | MP3DObject target domain (evaluation) | Chamfer Distance (CD)6.61 | 12 | |
| Point Cloud Reconstruction | ShapeNet target domain (evaluation) | Chamfer Distance (CD)7.64 | 12 | |
| Point Cloud Reconstruction | ScanNet target domain (Evaluation) | Chamfer Distance (CD)2.97 | 12 | |
| Point Cloud Reconstruction | MP3DObject target domain (evaluation) | Chamfer Distance (CD)3.55 | 12 |