Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Inference Throughput on Alpaca
Loading...
3,348.18
Prefill Throughput (tokens/s)
BUDDY
1,689.3592
2,120.0146
2,550.67
2,981.3254
Jun 8, 2026
Prefill Throughput (tokens/s)
Prefill Speedup
Decode Throughput (tokens/s)
Decode Speedup
Updated 1mo ago
Evaluation Results
Method
Method
Links
Prefill Throughput (tokens/s)
Prefill Speedup
Decode Throughput (tokens/s)
Decode Speedup
BUDDY
RM Blocks=16(50%)
2026.06
3,348.18
1.91
64.84
1.64
BUDDY
RM Blocks=12(37.5%)
2026.06
2,548.39
1.45
51.49
1.3
BUDDY
RM Blocks=8(25%)
2026.06
2,440.14
1.39
46.8
1.19
BUDDY
RM Blocks=4(12.5%)
2026.06
1,991.54
1.14
40.03
1.01
Dense
RM Blocks=0(0.0%)
2026.06
1,753.16
1
39.48
1
Feedback
Search any
task
Search any
task
