Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Wikihop

Benchmarks

Task NameDataset NameSOTA ResultTrend
Question AnsweringWikiHop (test)
Accuracy74
32
Multi-hop Reading ComprehensionWikiHop unmasked (dev)
Accuracy66.4
11
Multi-hop Question AnsweringWikiHop (dev)
Accuracy79.8
10
Multi-hop Reading ComprehensionWikiHop unmasked (test)
Accuracy70.6
9
Question AnsweringWikiHop (dev)
Accuracy75.9
8
Reading ComprehensionWikihop (dev)
Follow61.4
6
Multi-hop Question AnsweringWikiHop masked (dev)
Accuracy72.1
3
Question AnsweringWikiHop May 2020 (leaderboard)
F1 Score81.9
2
Reading ComprehensionWikihop (test)
Overall Score59.3
2
Multi-hop Question AnsweringWikiHop leaderboard official (test)
Accuracy0.8225
1
Showing 10 of 10 rows