Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Audio Question Answering on RACE Audio
Loading...
64.21
Accuracy (Sub-task 1)
Uni-MoE w/ MoE-Task4 (4E)
1.6332
17.8791
34.125
50.3709
May 18, 2024
Accuracy (Sub-task 1)
Accuracy (Sub-task 2)
Updated 3d ago
Evaluation Results
Method
Method
Links
Accuracy (Sub-task 1)
Accuracy (Sub-task 2)
Uni-MoE w/ MoE-Task4 (4E)
Modality=I,T,S,V, Trai...
2024.05
64.21
64.72
Uni-MoE w/ MoE-Task4 (4E) + Aux loss
Modality=I,T,S,V, Trai...
2024.05
63.86
64.24
Uni-MoE w/ MoE-Task4 (8E)
Modality=I,T,S,V, Trai...
2024.05
63.75
61.56
Uni-MoE w/ MoE-Task4 (8E) + Aux loss
Modality=I,T,S,V, Trai...
2024.05
62.33
64.18
Uni-MoE w/ MoE-Task2 (4E)
Modality=I,T,S,V, Trai...
2024.05
49.65
49.37
Uni-MoE w/ MoE-Task1 (4E)
Modality=I,T,S, Traini...
2024.05
47.08
47.08
Single-Modality-Expert-Task6
Modality=I,T,S, Traini...
2024.05
32.59
29.02
Single-Modality-Expert-Task5
Modality=I,T,S, Traini...
2024.05
30.78
24.9
X-InstructBLIP
Modality=Image, Text,...
2024.05
16.33
18.88
Macaw-LLM
Modality=Image, Text,...
2024.05
4.04
3
Feedback
Search any
task
Search any
task