Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Knowledge Attribution Causal Ablation on MultiLoKo (test)
Loading...
50.1
Ablation Success Rate
XICI
1.012
13.756
26.5
39.244
Mar 17, 2026
Ablation Success Rate
Spurious Gain Rate
Rate Difference
Num. Inconsistent Questions
Number of Languages
Number of Blacklisted Experts
Num. Questions with Experts Identified
Avg. Experts Identified per Question
Original Correct Count
Num. Questions All Incorrect
Updated 1mo ago
Evaluation Results
Method
Method
Links
Ablation Success Rate
Spurious Gain Rate
Rate Difference
Num. Inconsistent Questions
Number of Languages
Number of Blacklisted Experts
Num. Questions with Experts Identified
Avg. Experts Identified per Question
Original Correct Count
Num. Questions All Incorrect
XICI
Model=GLM-4.5-Air, Det...
2026.03
50.1
4.2
45.9
158
31
290
125
15.2
1,752
28
XICI
Model=Qwen3-30B-A3B-In...
2026.03
34.5
3
31.6
139
31
270
102
9.1
1,005
10
Random Question-Shuffling (baseline)
Model=Qwen3-30B-A3B-In...
2026.03
7.3
2.7
4.6
-
-
-
-
-
-
-
Random Question-Shuffling (baseline)
Model=GLM-4.5-Air, Det...
2026.03
6.6
3
3.6
-
-
-
-
-
-
-
Random Expert Set of Same Size (baseline)
Model=GLM-4.5-Air, Det...
2026.03
4.1
3.4
0.7
-
-
-
-
-
-
-
Random Expert Set of Same Size (baseline)
Model=Qwen3-30B-A3B-In...
2026.03
2.9
1.8
1.1
-
-
-
-
-
-
-
Feedback
Search any
task
Search any
task