Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Editing Copy-as-Decode Efficiency Analysis on Pooled (All)
Loading...
482
Number of Cases
Copy-as-Decode (Oracle)
457.9
469.95
482
494.05
Apr 20, 2026
Number of Cases
Total Gold Tokens
Copied Tokens
Generated Tokens
Copy Fraction
Total Copy Operations
Mean Copy Span Length
Median Copy Span Length
95th Percentile Copy Span Length
Kernel Speedup (m=8)
Conservative Speedup Bound (m=8)
Aspirational Speedup Bound (Mean Span)
Tightest Speedup Bound
Updated 1mo ago
Evaluation Results
Method
Method
Links
Number of Cases
Total Gold Tokens
Copied Tokens
Generated Tokens
Copy Fraction
Total Copy Operations
Mean Copy Span Length
Median Copy Span Length
95th Percentile Copy Span Length
Kernel Speedup (m=8)
Conservative Speedup Bound (m=8)
Aspirational Speedup Bound (Mean Span)
Tightest Speedup Bound
Copy-as-Decode (Oracle)
Alignment=difflib.Sequ...
2026.04
482
124,861
117,146
7,715
93.8
927
126.4
34
537
6.79
5
13.6
13.01
Feedback
Search any
task
Search any
task