Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on BioASQ MRQA Out-of-domain
Loading...
49.37
F1 Score
Full-FT
26.8956
32.7303
38.565
44.3997
Oct 10, 2025
F1 Score
Exact Match (EM)
Updated 1mo ago
Evaluation Results
Method
Method
Links
F1 Score
Exact Match (EM)
Full-FT
Evaluation Protocol=Fi...
2025.10
49.37
36.77
SAC
Compression Ratio=15x,...
2025.10
41.31
28.66
EPL
Compression Ratio=15x,...
2025.10
40.52
28.52
DAST
Compression Ratio=15x,...
2025.10
36.57
27.06
500x
Compression Ratio=15x,...
2025.10
36.3
25.93
Beacon
Compression Ratio=15x,...
2025.10
36.07
7.65
ICAE
Compression Ratio=15x,...
2025.10
35.51
24.47
Lingua-2
Compression Ratio=5x,...
2025.10
27.76
19.48
Feedback
Search any
task
Search any
task