Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long-sequence generation on PG19 synthetic prompts
Loading...
80
Max Batch Size
SnapKV
25.92
39.96
54
68.04
May 21, 2026
Max Batch Size
Throughput (tokens/s)
Updated 11d ago
Evaluation Results
Method
Method
Links
Max Batch Size
Throughput (tokens/s)
SnapKV
Generation Length=10K,...
2026.05
80
413.28
Judge Q
Generation Length=10K,...
2026.05
80
398.15
Meta-Soft
Generation Length=10K,...
2026.05
80
390.17
Full cache
Generation Length=10K,...
2026.05
28
180.49
Feedback
Search any
task
Search any
task