Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

File-level Localization on SWE-Bench-Lite latest (test)

77.74NDCG@1

LocAgent

37.12847.671558.21568.7585Mar 12, 2025
Updated 1mo ago

Evaluation Results

MethodLinks
2025.03
77.7486.1987.14
2025.03
77.3784.3284.93
2025.03
76.2884.2784.43
2025.03
75.9184.7485.64
2025.03
73.3680.0380.33
2025.03
72.6376.7276.87
2025.03
72.6380.7380.88
2025.03
70.879.3680.9
2025.03
67.1571.7671.76
2025.03
60.9567.6268.39
2025.03
57.363.9664.12
2025.03
52.5567.5470.39
2025.03
49.6464.1966.6
2025.03
47.8160.8264.39
2025.03
43.4359.9363.7
2025.03
38.6946.550.61