Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NQ (Natural Questions)

Benchmarks

Task NameDataset NameSOTA ResultTrend
Single-hop Question AnsweringNQ (Natural Questions) (test)
Accuracy45.3
21
Single-Hop Question AnsweringNQ (Natural Questions) 2018 Wikipedia dump (dev)
Accuracy50.2
14
Question AnsweringNQ (Natural Questions) December 2018 Wikipedia dump (test)
EM36.9
14
Question RetrievalNQ (Natural Questions) (full)
Retrieval Accuracy40.9
12
Question AnsweringNQ (Natural Questions) in-domain (test)
LasJ Score58.03
11
Showing 5 of 5 rows