Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Query Generation on Semantic Variants subset
Loading...
98
Accuracy
Gemini
94.048
95.074
96.1
97.126
Apr 3, 2026
Accuracy
Syntax Errors
Location Errors
Other Errors
Updated 13d ago
Evaluation Results
Method
Method
Links
Accuracy
Syntax Errors
Location Errors
Other Errors
Gemini
Mode=Zero-shot, Struct...
2026.04
98
0
2
0
DeepSeek R1
Mode=Zero-shot, Struct...
2026.04
97.2
0
0.2
2.6
GPT4
Mode=Zero-shot, Struct...
2026.04
97.2
0
0.4
2.4
Grok
Mode=Zero-shot, Struct...
2026.04
97
0
0
3
DeepSeek R1-Distill-8B fine-tuned with QLoRA
Mode=Fine-tuned
2026.04
94.2
0
0
5.8
Feedback
Search any
task
Search any
task