Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CoMA

Benchmarks

Task NameDataset NameSOTA ResultTrend
System Prompt Corruption (SPC)COMA Evaluation Suite
DSR100
30
Question Answering (Q&A)COMA Evaluation Suite
DSR10
30
Adversarial Task Switching (ATS)COMA Evaluation Suite
DSR14
30
3D Face ReconstructionCoMA
Mean Error0.351
16
Cooperative Multi-agent Reinforcement Learning (coo-MARL)COMA Poisoned
Average Winning Rate94.2
8
Cooperative Multi-agent Reinforcement Learning (coo-MARL)COMA Clean
Average Winning Rate96.1
8
4D Facial Expression GenerationCoMA (test)
Classification Accuracy73.61
6
3D Face ReconstructionCoMA mouth up (extrapolation)
Mean Error1.097
3
3D Face ReconstructionCoMA mouth side (extrapolation)
Mean Error (mm)1.264
3
3D Face ReconstructionCoMA mouth open (extrapolation)
Mean Error (mm)0.961
3
3D Face ReconstructionCoMA mouth middle (extrapolation)
Mean Error (mm)1.017
3
3D Face ReconstructionCoMA mouth extreme (extrapolation)
Mean Error (mm)1.336
3
3D Face ReconstructionCoMA mouth down (extrapolation)
Mean Error (mm)1.05
3
3D Face ReconstructionCoMA lips up (extrapolation)
Mean Error (mm)1.081
3
3D Face ReconstructionCoMA lips back (extrapolation)
Mean Error (mm)1.193
3
3D Face ReconstructionCoMA high smile (extrapolation)
Mean Error (mm)1.205
3
3D Face ReconstructionCoMA eyebrow (extrapolation)
Mean Error (mm)1.053
3
3D Face ReconstructionCoMA cheeks in (extrapolation)
Mean Error (mm)1.288
3
3D Face ReconstructionCoMA bareteeth (extrapolation)
Mean Error (mm)1.376
3
3D Face ReconstructionCoMA (identity-independent)
Metric-
0
3D Face ReconstructionCoMA (expression-independent)
Metric-
0
Showing 21 of 21 rows