Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Query Generation on SIEM executable queries AQL and YARA-L (test)
Loading...
0.384
BLEU
SQM
0.06888
0.15069
0.2325
0.31431
Apr 30, 2026
BLEU
ROUGE-L
Updated 1mo ago
Evaluation Results
Method
Method
Links
BLEU
ROUGE-L
SQM
Architecture=Syntax-co...
2026.04
0.384
0.731
Qwen3
Model Type=Base Model
2026.04
0.149
0.522
gpt-4o
Model Type=Base Model
2026.04
0.14
0.508
DeepSeek-V3
Model Type=Base Model
2026.04
0.137
0.492
gemma
Model Type=Base Model
2026.04
0.121
0.495
gpt-4o-mini
Model Type=Base Model
2026.04
0.091
0.462
Llama-3.3
Model Type=Base Model
2026.04
0.081
0.429
Feedback
Search any
task
Search any
task