Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Task Completion on Writer Evaluation Suite locked judge protocol blended across models
Loading...
0.81
Task Completion Quality Score
Writer Agent Harness
0.7788
0.7869
0.795
0.8031
Jul 8, 2026
Task Completion Quality Score
Cost Per Task
Median Wall-clock Time Per Task (s)
Tokens Per Task
Quality Per Dollar
Completions Per Million Tokens (CPM)
Subjective UI/UX Score
Updated 17d ago
Evaluation Results
Method
Method
Links
Task Completion Quality Score
Cost Per Task
Median Wall-clock Time Per Task (s)
Tokens Per Task
Quality Per Dollar
Completions Per Million Tokens (CPM)
Subjective UI/UX Score
Writer Agent Harness
Orchestration Setup=Ha...
2026.07
0.81
0.12
27
8,800
6.75
92
-
Baseline
Orchestration Setup=Ba...
2026.07
0.78
0.21
48
14,200
3.71
54.9
-
Feedback
Search any
task
Search any
task