Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Role Clarity on SWE easy (dev)
Loading...
0.9081
Role Clarity Score
ChatDev
0.483676
0.593863
0.70405
0.814237
Apr 3, 2026
Role Clarity Score
Role Clarity Delta
Updated 13d ago
Evaluation Results
Method
Method
Links
Role Clarity Score
Role Clarity Delta
ChatDev
CEO=FT, CPO=FT, Backbo...
2026.04
0.9081
0.3721
ChatDev
CEO=FT, CPO=FT, Backbo...
2026.04
0.8525
0.3525
ChatDev
CEO=FT, CPO=Base, Back...
2026.04
0.6583
0.1223
ChatDev
CEO=Base, CPO=FT, Back...
2026.04
0.6014
0.0654
ChatDev
CEO=FT, CPO=Base, Back...
2026.04
0.5975
0.0975
ChatDev
CEO=Base, CPO=FT, Back...
2026.04
0.5635
0.0635
ChatDev
CEO=Base, CPO=Base, Ba...
2026.04
0.536
-
ChatDev
CEO=Base, CPO=Base, Ba...
2026.04
0.5
-
Feedback
Search any
task
Search any
task
