Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

IIRC

Benchmarks

Task NameDataset NameSOTA ResultTrend
Question AnsweringIIRC
EM20.1
15
Question AnsweringIIRC
Prefill Speedup Ratio4.72
12
Multi-hop Question AnsweringIIRC
EM28.2
7
RetrievalIIRC (test)
Retrieval EM86.9
4
Multi-hop Question AnsweringIIRC (dev)
EM68.1
4
Question AnsweringIIRC (test)
EM17.19
3
Showing 6 of 6 rows