Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Agent Utility Evaluation on PinchBench v2.0.0
Loading...
89.6
Utility Score
Output guardrail
61.416
68.733
76.05
83.367
Jul 4, 2026
Utility Score
Token Overhead
Updated 18d ago
Evaluation Results
Method
Method
Links
Utility Score
Token Overhead
Output guardrail
Model=Claude Sonnet 4.6
2026.07
89.6
13.2
Input guardrail
Model=Claude Sonnet 4.6
2026.07
88.8
5.3
Baseline
Model=Claude Sonnet 4.6
2026.07
88.5
0
Dual LLM
Model=Claude Sonnet 4.6
2026.07
86.3
61
Input guardrail
Model=Claude Haiku 4.5
2026.07
85.3
18.3
Output guardrail
Model=Claude Haiku 4.5
2026.07
84.7
14.4
Baseline
Model=Claude Haiku 4.5
2026.07
83.4
0
DUALVIEW
Model=Claude Sonnet 4.6
2026.07
82.1
93.4
Dual LLM
Model=Claude Haiku 4.5
2026.07
81.8
40.8
DUALVIEW
Model=Claude Haiku 4.5
2026.07
81.6
48.2
Sandboxing
Model=Claude Sonnet 4.6
2026.07
66.5
115.6
Sandboxing
Model=Claude Haiku 4.5
2026.07
62.5
57.6
Feedback
Search any
task
Search any
task