Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Terminal Agent Tasks on Internal (ITD) (dev)
Loading...
22.7
Pass@1
OT-SFT
6.372
10.611
14.85
19.089
May 23, 2026
Pass@1
Updated 2mo ago
Evaluation Results
Method
Method
Links
Pass@1
OT-SFT
Setup=ECHO
2026.05
22.7
Qwen3-14B
Setup=ECHO
2026.05
19.8
Qwen3-8B
Setup=ECHO
2026.05
18.9
OT-SFT
Setup=GRPO
2026.05
18.8
Qwen3-14B
Setup=GRPO
2026.05
17.9
Qwen3-8B
Setup=GRPO
2026.05
16.2
Qwen3-14B
Setup=Base
2026.05
12.1
OT-SFT
Setup=SFT
2026.05
10.7
Qwen3-8B
Setup=Base
2026.05
7
Feedback
Search any
task
Search any
task
