Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Multi-hop Question Answering on 2WikiMultiHopQA (dev)
Loading...
68.6
Exact Match Accuracy
MCR+SC@3
-0.456
17.472
35.4
53.328
Oct 7, 2022
Nov 9, 2022
Dec 12, 2022
Jan 15, 2023
Feb 17, 2023
Mar 22, 2023
Apr 25, 2023
Exact Match Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Exact Match Accuracy
MCR+SC@3
Retrieval=yes, LLM=cod...
2023.04
68.6
MCR
Retrieval=yes, LLM=cod...
2023.04
67.9
IR-COT
Retrieval=yes, LLM=cod...
2023.04
65.2
Self-Ask (ours)
Retrieval=yes, LLM=cod...
2023.04
63.8
Self-Ask
Retrieval=yes, LLM=tex...
2023.04
52.6
Self-ask + Search
Model=Davinci-002
2022.10
40.1
Self-ask
Model=Davinci-002
2022.10
30
Chain of Thought
Model=Davinci-002
2022.10
29.8
Search + postproc.
Model=Davinci-002
2022.10
26.3
Direct prompting
Model=Davinci-002
2022.10
25.4
Search
Model=Davinci-002
2022.10
2.2
Feedback
Search any
task
Search any
task