Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long-context Text Generation on RULER
Loading...
3.43
Mean Throughput
FastKV
1.4956
1.9978
2.5
3.0022
Jan 12, 2026
Mean Throughput
Median Throughput
P95 Throughput
P99 Throughput
Updated 1mo ago
Evaluation Results
Method
Method
Links
Mean Throughput
Median Throughput
P95 Throughput
P99 Throughput
FastKV
Backbone=Qwen2.5-7B, K...
2026.01
3.43
2.19
0.57
0.29
GemFilter
Backbone=Qwen2.5-7B, K...
2026.01
3.32
2.2
0.41
0.14
FastKV
Backbone=Llama-3.1-8B-...
2026.01
3.07
1.84
0.49
0.36
GemFilter
Backbone=Llama-3.1-8B-...
2026.01
2.36
1.6
0.28
0.14
ASL
Backbone=Qwen2.5-7B, K...
2026.01
2.35
1.54
0.4
0.21
ASL
Backbone=Llama-3.1-8B-...
2026.01
2.27
0.98
0.29
0.26
ASL_2pass
Backbone=Qwen2.5-7B, K...
2026.01
1.82
1.82
0.29
0.11
ASL_2pass
Backbone=Llama-3.1-8B-...
2026.01
1.57
0.7
0.18
0.09
Feedback
Search any
task
Search any
task
