Share your thoughts, 1 month free Claude Pro on usSee more

SQL Generation on BacktestBench synthetic (test)

100Execution Correctness Rate (ECR)

Qwen3 235B

Updated 2mo ago

Evaluation Results

Method	Links
Qwen3 235B 2026.05		100	97.11
Qwen3 32B 2026.05		100	90.72
Qwen3 Max 2026.05		100	94.73
Qwen3 30B 2026.05		99.97	92.86
Qwen3 8B 2026.05		99.97	86.89
Deepseek V3.2 2026.05		99.97	92.86
Qwen3 14B 2026.05		99.95	87.59
Qwen3 Coder Plus 2026.05		99.95	94.03
Qwen3 Next 80B 2026.05		99.92	94.79
GLM 4.7 2026.05		99.92	94.86
Gemini 3 Pro 2026.05		99.64	98.7
MiniMax M2.1 2026.05		99.56	95.02
GPT OSS 120B 2026.05		99.43	96.58
Seed 1.8 2026.05		99.4	97.45
Kimi Linear 48B 2026.05		99.22	48.46
Qwen3 4B 2026.05		98.85	69.94
Kimi K2 Thinking 2026.05		98.2	96.06
Mimo V2 Flash 2026.05		97.84	80.42
GLM 4.7 Flash 2026.05		97.81	56.8
Ministral 3 14B 2026.05		97.18	72.26
GPT OSS 20B 2026.05		94.34	90.56
Ministral 3 8B 2026.05		92.23	46.35
Seed OSS 36B 2026.05		91.16	87.96