Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multi-turn tool-use on τ³-airline 20-task (held-out)
Loading...
60.2
Pass@1
SGCD
30.56
38.255
45.95
53.645
Jun 10, 2026
Pass@1
Action Success Rate
Information Success Rate
Updated 1mo ago
Evaluation Results
Method
Method
Links
Pass@1
Action Success Rate
Information Success Rate
SGCD
step=120
2026.06
60.2
43.5
93.8
GRPO+KL
step=120
2026.06
58.3
41
91.7
SFT base
step=800
2026.06
43.8
26.9
68.8
SDPO
step=300
2026.06
31.7
0
91.7
Feedback
Search any
task
Search any
task
