Beyond Binary Contrast: Modeling Continuous Skeleton Action Spaces with Transitional Anchors
About
Self-supervised contrastive learning has emerged as a powerful paradigm for skeleton-based action recognition by enforcing consistency in the embedding space. However, existing methods rely on binary contrastive objectives that overlook the intrinsic continuity of human motion, resulting in fragmented feature clusters and rigid class boundaries. To address these limitations, we propose TranCLR, a Transitional anchor-based Contrastive Learning framework that captures the continuous geometry of the action space. Specifically, the proposed Action Transitional Anchor Construction (ATAC) explicitly models the geometric structure of transitional states to enhance the model's perception of motion continuity. Building upon these anchors, a Multi-Level Geometric Manifold Calibration (MGMC) mechanism is introduced to adaptively calibrate the action manifold across multiple levels of continuity, yielding a smoother and more discriminative representation space. Extensive experiments on the NTU RGB+D, NTU RGB+D 120 and PKU-MMD datasets demonstrate that TranCLR achieves superior accuracy and calibration performance, effectively learning continuous and uncertainty-aware skeleton representations. The code is available at https://github.com/Philchieh/TranCLR.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Action Recognition | NTU RGB+D 120 (X-set) | Accuracy79 | 770 | |
| Action Recognition | NTU RGB+D X-sub 120 | Accuracy78.8 | 473 | |
| Action Recognition | PKU-MMD (Part II) | Accuracy65.6 | 90 | |
| Action Recognition | NTU-RGB+D (X-Sub) | Accuracy86.3 | 62 | |
| Action Recognition | NTU RGB+D | Accuracy88.5 | 50 | |
| Skeleton-based Action Recognition | PKU-MMD (Part II) | Accuracy59.9 | 21 | |
| Skeleton-based Action Recognition | PKU-MMD Part I | Accuracy92.8 | 17 | |
| Action Recognition | NTU-RGB+D (X-View) | Accuracy90.7 | 16 | |
| Action Recognition | NTU RGB+D Average 120 | Accuracy78.9 | 16 | |
| Skeleton-based Action Retrieval | NTU 60 (X-sub) | Accuracy74.6 | 7 |