Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on MRQA In-domain
Loading...
63.63
F1 Score
SAC
39.4604
45.7352
52.01
58.2848
Oct 10, 2025
F1 Score
Exact Match (EM)
Updated 1mo ago
Evaluation Results
Method
Method
Links
F1 Score
Exact Match (EM)
SAC
Compression Ratio=5x
2025.10
63.63
46.95
EPL
Compression Ratio=5x
2025.10
62.9
46.33
500x
Compression Ratio=5x
2025.10
55.26
40.14
SAC
Compression Ratio=15x
2025.10
54.95
39.67
EPL
Compression Ratio=15x
2025.10
51.52
36.65
500x
Compression Ratio=15x
2025.10
49.35
34.98
ICAE
Compression Ratio=5x
2025.10
47.53
33.82
SAC
Compression Ratio=51x
2025.10
46.37
33.08
ICAE
Compression Ratio=15x
2025.10
44.5
31.28
EPL
Compression Ratio=51x
2025.10
43.22
30.26
500x
Compression Ratio=51x
2025.10
43.19
30.26
ICAE
Compression Ratio=51x
2025.10
40.39
27.99
Feedback
Search any
task
Search any
task
