Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Editing Copy-as-Decode Efficiency Analysis on HEvalFix JavaScript
Loading...
164
Number of Cases
Copy-as-Decode (Oracle)
155.8
159.9
164
168.1
Apr 20, 2026
Number of Cases
Total Gold Tokens
Copied Tokens
Generated Tokens
Copy Fraction
Total Copy Operations
Mean Copy Span Length
Median Copy Span Length
P95 Copy Span Length
Kernel Speedup (m=8)
Conservative Speedup Bound (m=8)
Aspirational Speedup Bound (Mean Span)
Tightest Speedup Bound
Updated 1mo ago
Evaluation Results
Method
Method
Links
Number of Cases
Total Gold Tokens
Copied Tokens
Generated Tokens
Copy Fraction
Total Copy Operations
Mean Copy Span Length
Median Copy Span Length
P95 Copy Span Length
Kernel Speedup (m=8)
Conservative Speedup Bound (m=8)
Aspirational Speedup Bound (Mean Span)
Tightest Speedup Bound
Copy-as-Decode (Oracle)
Alignment=difflib.Sequ...
2026.04
164
14,876
11,725
3,151
78.8
311
37.7
25
102
6.79
3.05
4.15
4.18
Feedback
Search any
task
Search any
task