Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on MRQA Out-of-domain
Loading...
47.72
F1 Score
SAC
27.1904
32.5202
37.85
43.1798
Oct 10, 2025
F1 Score
Exact Match (EM)
Updated 1mo ago
Evaluation Results
Method
Method
Links
F1 Score
Exact Match (EM)
SAC
Compression Ratio=5x
2025.10
47.72
32.3
EPL
Compression Ratio=5x
2025.10
46.95
31.3
SAC
Compression Ratio=15x
2025.10
39.26
26.02
500x
Compression Ratio=5x
2025.10
38.46
25.4
EPL
Compression Ratio=15x
2025.10
36.74
23.83
500x
Compression Ratio=15x
2025.10
34.04
22.09
SAC
Compression Ratio=51x
2025.10
32.24
21.44
ICAE
Compression Ratio=5x
2025.10
31.22
20.51
ICAE
Compression Ratio=15x
2025.10
30.81
20.18
500x
Compression Ratio=51x
2025.10
30.43
20.09
EPL
Compression Ratio=51x
2025.10
30.22
19.48
ICAE
Compression Ratio=51x
2025.10
27.98
17.85
Feedback
Search any
task
Search any
task
