Machine-generated code detection on SemEval Task 13 Subtask A 2026 official (test)

78.9Macro F1

SALSA Tuned (Qwen2.5-72B-Instruct)

Updated 1mo ago

Evaluation Results

Method	Links
SALSA Tuned (Qwen2.5-72B-Instruct) 2026.06		78.9
SALSA Tuned (Qwen3-32B) 2026.06		76
SALSA Tuned (Qwen3-32B official) 2026.06		73
gemma-3-27b-pt_th1 2026.04		69.753
codegemma-1.1-7b-it_th1 2026.04		64.625
codegemma-7b_th1 2026.04		64.435
Qwen2.5-Coder-14B_th1 2026.04		63.818
codegemma-7b 2026.04		59.628
SALSA Zero-shot (Qwen3-Next-80B-A3B-Instruct) 2026.06		59.1
Qwen2.5-Coder-7B 2026.04		57.799
CodeLlama-70b-hf_th1 2026.04		56.363
CodeLlama-70b-hf 2026.04		54.776
Qwen2.5-Coder-14B 2026.04		54.498
codegemma-1.1-7b-it 2026.04		54.183
Qwen2.5-Coder-32B 2026.04		51.694
SALSA Zero-shot (Qwen3-32B) 2026.06		50.8
random baseline 2026.04		50
Qwen2.5-Coder-0.5B 2026.04		49.474
gemma-3-27b-pt 2026.04		48.006
SALSA Tuned (Qwen3-8B) 2026.06		45
SALSA Zero-shot (Qwen2.5-72B-Instruct) 2026.06		44.9
SALSA Zero-shot (Qwen3-8B) 2026.06		43.6
CodeBERT baseline 2026.04		30.53
CodeBERT 2026.06		30.5