Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Editing Copy-as-Decode Efficiency Analysis on ProbeEdit
Loading...
154
Number of Cases
Copy-as-Decode (Oracle)
146.3
150.15
154
157.85
Apr 20, 2026
Number of Cases
Total Gold Tokens
Copied Tokens
Generated Tokens
Copy Fraction
Total Copy Operations
Mean Copy Span Length
Median Copy Span Length
P95 Copy Span Length
Kernel Speedup (m=8)
Conservative Speedup Bound (m=8)
Aspirational Speedup Bound (Mean Span)
Tightest Speedup Bound
Updated 1mo ago
Evaluation Results
Method
Method
Links
Number of Cases
Total Gold Tokens
Copied Tokens
Generated Tokens
Copy Fraction
Total Copy Operations
Mean Copy Span Length
Median Copy Span Length
P95 Copy Span Length
Kernel Speedup (m=8)
Conservative Speedup Bound (m=8)
Aspirational Speedup Bound (Mean Span)
Tightest Speedup Bound
Copy-as-Decode (Oracle)
Alignment=difflib.Sequ...
2026.04
154
101,113
98,844
2,269
97.8
321
307.9
266
543
6.79
6.01
29.1
29.02
Feedback
Search any
task
Search any
task