Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Failure Diagnosis on MBPP
Loading...
50
Macro Similarity Score
PROBELLM
11.52
21.51
31.5
41.49
Feb 13, 2026
Macro Similarity Score
Micro Similarity Score
Error Rate
Average Error Rate
Number of Clusters
Updated 1mo ago
Evaluation Results
Method
Method
Links
Macro Similarity Score
Micro Similarity Score
Error Rate
Average Error Rate
Number of Clusters
PROBELLM
Target Model=GPT-4.1,...
2026.02
50
50
22
36
6
PROBELLM
Target Model=GPT-5.2,...
2026.02
35
65
25
29
5
PROBELLM
Target Model=Ministral...
2026.02
32
68
77
74
19
PROBELLM
Target Model=Mistral-7...
2026.02
31
69
82
81
16
PROBELLM
Target Model=Ministral...
2026.02
31
69
49
57
16
PROBELLM
Target Model=GPT-3.5-t...
2026.02
26
74
80
75
16
PROBELLM
Target Model=GPT-4o-mi...
2026.02
20
80
65
63
10
PROBELLM
Target Model=Mistral-7...
2026.02
13
87
87
78
20
Feedback
Search any
task
Search any
task
