Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Understanding on RepoQA and CodeQueries (zero-shot)
Loading...
65.6
Accuracy
Text
0.704
17.552
34.4
51.248
May 7, 2026
Accuracy
ECR (Factor)
Selection Accuracy
Updated 23d ago
Evaluation Results
Method
Method
Links
Accuracy
ECR (Factor)
Selection Accuracy
Text
Compression Rate=5x
2026.05
65.6
-
-
Text
Compression Rate=10x
2026.05
65.6
-
-
Text
Compression Rate=15x
2026.05
65.6
-
-
LensVLM
Compression Rate=5x
2026.05
38.1
3.2
55.5
Glyph
Compression Rate=5x
2026.05
31.8
-
-
Comp. Image
Compression Rate=5x
2026.05
26.7
-
-
LensVLM
Compression Rate=10x
2026.05
26.1
6.3
43.5
LensVLM
Compression Rate=15x
2026.05
20
8.2
31.7
Glyph
Compression Rate=10x
2026.05
9.7
-
-
Glyph
Compression Rate=15x
2026.05
7
-
-
Comp. Image
Compression Rate=10x
2026.05
6.1
-
-
Comp. Image
Compression Rate=15x
2026.05
3.2
-
-
Feedback
Search any
task
Search any
task