Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sarcasm Understanding on MuSTARD++
Loading...
83.2
F1 Score
MuVaC
45.24
55.095
64.95
74.805
Jan 28, 2026
Feb 18, 2026
Mar 11, 2026
Apr 1, 2026
Apr 22, 2026
May 13, 2026
Jun 4, 2026
F1 Score
Precision
Recall
Updated 1mo ago
Evaluation Results
Method
Method
Links
F1 Score
Precision
Recall
MuVaC
2026.01
83.2
81.2
85.3
ProSarc
Modality=Audio-only
2026.06
75.3
-
-
Llama 3.1
Fine-tuned=false
2026.01
66.8
50.3
99.3
Tiwari et al., 2023
Modality=Audio-only
2026.06
66.6
-
-
Qwen 2.5
Fine-tuned=false
2026.01
65.5
57.4
76.2
Ray et al. (2022)
Modality=Audio-only
2026.06
64.5
-
-
Qwen 2.5 VL
Fine-tuned=true
2026.01
63.8
74.4
55.8
MiniCPM-V 2.6
Fine-tuned=false
2026.01
61.3
52.4
73.7
Qwen 2.5 VL
Fine-tuned=false
2026.01
53.4
63.2
46.2
Kimi VL
Fine-tuned=false
2026.01
46.7
55.6
40.2
Feedback
Search any
task
Search any
task