Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Tool-use instruction following on ToolBench I2-Category
Loading...
0.775
Pass Rate
DFSDT
-0.031
0.17825
0.3875
0.59675
Jul 31, 2023
Pass Rate
Win Rate
Updated 4d ago
Evaluation Results
Method
Method
Links
Pass Rate
Win Rate
DFSDT
Backbone=GPT-4, Retrie...
2023.07
0.775
63.3
DFSDT
Backbone=ToolLLaMA, Re...
2023.07
0.77
58
ReACT
Backbone=GPT-4, Retrie...
2023.07
0.72
60.3
DFSDT
Backbone=ChatGPT, Retr...
2023.07
0.715
64.8
DFSDT
Backbone=ToolLLaMA, Re...
2023.07
0.685
60.8
ReACT
Backbone=ChatGPT, Retr...
2023.07
0.465
-
DFSDT
Backbone=Text-Davinci-...
2023.07
0.42
43.3
ReACT
Backbone=ToolLLaMA, Re...
2023.07
0.315
41.8
DFSDT
Backbone=Claude-2, Ret...
2023.07
0.205
33.5
ReACT
Backbone=Text-Davinci-...
2023.07
0.145
29.8
ReACT
Backbone=Claude-2, Ret...
2023.07
0.06
31.5
ReACT & DFSDT
Backbone=Vicuna, Retri...
2023.07
0
0
ReACT & DFSDT
Backbone=Alpaca, Retri...
2023.07
0
0
Feedback
Search any
task
Search any
task