Joint Skeletal and Semantic Embedding Loss for Micro-gesture Classification
About
In this paper, we briefly introduce the solution of our team HFUT-VUT for the Micros-gesture Classification in the MiGA challenge at IJCAI 2023. The micro-gesture classification task aims at recognizing the action category of a given video based on the skeleton data. For this task, we propose a 3D-CNNs-based micro-gesture recognition network, which incorporates a skeletal and semantic embedding loss to improve action classification performance. Finally, we rank 1st in the Micro-gesture Classification Challenge, surpassing the second-place team in terms of Top-1 accuracy by 1.10%.
Kun Li, Dan Guo, Guoliang Chen, Xinge Peng, Meng Wang• 2023
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Micro-gesture recognition | iMiGUE (test) | Top-1 Acc64.12 | 42 | |
| Micro-gesture classification | iMiGUE | Top-1 Accuracy64.12 | 22 | |
| Micro-gesture classification | SMG (test) | -- | 13 | |
| Micro-gesture recognition | iMiGUE MiGA Track-1 (test) | Accuracy70.25 | 11 | |
| Micro-gesture recognition | SMG | Top-1 Accuracy68.03 | 6 |
Showing 5 of 5 rows