Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Code Understanding on CodeMMLU

53.52Exact Match (EM)

W/O (FP16)

19.293628.179337.06545.9507Nov 9, 2025
Updated 15d ago

Evaluation Results

MethodLinks
2025.11
53.5217.21
2025.11
51.3214.19
2025.11
51.275.75
2025.11
51.036.76
2025.11
50.836.76
2025.11
50.685.74
2025.11
50.549.02
2025.11
50.448.31
2025.11
50.295.75
2025.11
49.519.05
2025.11
49.325.83
2025.11
49.229.05
2025.11
48.7814.19
2025.11
48.495.95
2025.11
47.413.2
2025.11
47.225.95
2025.11
47.175.83
2025.11
47.125.95
2025.11
47.042.77
2025.11
47.025.95
2025.11
46.832.25
2025.11
46.292.25
2025.11
40.285.19
2025.11
40.095.19
2025.11
35.165.19
2025.11
34.915.19
2025.11
24.661.93
2025.11
20.612.5