Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Security smell detection on Combined (Puppet, Ansible, Chef) oracle (test)
Loading...
83.1
Macro F1
IntelliSA
39.628
50.914
62.2
73.486
Jan 21, 2026
Macro F1
Updated 3mo ago
Evaluation Results
Method
Method
Links
Macro F1
IntelliSA
2026.01
83.1
Grok-4
model=Grok-4-fast, Pro...
2026.01
75.7
GLITCH
2026.01
69.4
Grok-4
model=Grok-4-fast, Pro...
2026.01
68.7
GPT-5
model=GPT-5-2025-08-07...
2026.01
65.3
Claude-4
model=Claude-Sonnet-4....
2026.01
62.2
Claude-4
model=Claude-Sonnet-4....
2026.01
55.9
GPT-5
model=GPT-5-2025-08-07...
2026.01
52.7
SLAC/SLIC
2026.01
41.3
Feedback
Search any
task
Search any
task
