Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Structured Generation on Bython
Loading...
1.39
Mean Generation Time (s)
Llama-3B
0.6648
5.5599
10.455
15.3501
May 28, 2026
Mean Generation Time (s)
Updated 5d ago
Evaluation Results
Method
Method
Links
Mean Generation Time (s)
Llama-3B
Constraint=Unconstrained
2026.05
1.39
Llama-3B
Constraint=+CFGZIP
2026.05
1.76
Qwen-4B
Constraint=Unconstrained
2026.05
2.34
GPT-20B
Constraint=Unconstrained
2026.05
2.67
Qwen-4B
Constraint=+CFGZIP
2026.05
2.72
GPT-20B
Constraint=+CFGZIP
2026.05
3.52
Llama-3B
Constraint=XGrammar2
2026.05
12.55
Qwen-4B
Constraint=XGrammar2
2026.05
19.5
GPT-20B
Constraint=XGrammar2
2026.05
19.52
Feedback
Search any
task
Search any
task
