Failure Detection and Reasoning on ARMBench
65Detect Acc.
Claude-3.7
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.02 | 65 | 68.5 | 72.5 | |
2026.02 | 64 | 60.9 | 61.8 | |
2026.02 | 59 | 49.4 | 38.7 | |
2026.02 | 50 | 34.9 | 20.8 | |
2026.02 | 50 | 0 | 6.7 | |
2026.02 | 48 | 50.3 | 48 |
Claude-3.7
| Method | Links | |||
|---|---|---|---|---|
2026.02 | 65 | 68.5 | 72.5 | |
2026.02 | 64 | 60.9 | 61.8 | |
2026.02 | 59 | 49.4 | 38.7 | |
2026.02 | 50 | 34.9 | 20.8 | |
2026.02 | 50 | 0 | 6.7 | |
2026.02 | 48 | 50.3 | 48 |