Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Structured Generation on C++
Loading...
1.42
Mean Generation Latency (s)
Llama-3B
1.2712
2.2756
3.28
4.2844
May 28, 2026
Mean Generation Latency (s)
Updated 5d ago
Evaluation Results
Method
Method
Links
Mean Generation Latency (s)
Llama-3B
Constraint=Unconstrained
2026.05
1.42
Llama-3B
Constraint=+CFGZIP
2026.05
1.47
Llama-3B
Constraint=XGrammar2
2026.05
2.14
GPT-20B
Constraint=Unconstrained
2026.05
2.34
GPT-20B
Constraint=+CFGZIP
2026.05
2.41
Qwen-4B
Constraint=Unconstrained
2026.05
2.48
Qwen-4B
Constraint=+CFGZIP
2026.05
2.55
GPT-20B
Constraint=XGrammar2
2026.05
4.59
Qwen-4B
Constraint=XGrammar2
2026.05
5.14
Feedback
Search any
task
Search any
task
