Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Module-level Localization on SWE-Bench-Lite (test)

77.73NDCG@5

LocAgent

35.693246.606657.5268.4334Mar 12, 2025
Updated 1mo ago

Evaluation Results

MethodLinks
2025.03
77.7378.1
2025.03
76.2876.77
2025.03
75.7975.92
2025.03
72.7772.9
2025.03
70.9971.68
2025.03
69.1169.11
2025.03
68.5769.09
2025.03
67.3667.36
2025.03
64.3164.31
2025.03
58.1858.6
2025.03
57.5159.76
2025.03
53.9553.95
2025.03
53.1554.45
2025.03
51.0254.13
2025.03
49.3852.22
2025.03
37.3139.86