Share your thoughts, 1 month free Claude Pro on usSee more

Machine-generated code detection on SemEval Task 13 Subtask A 2026 official (test)

69.753Macro F1

gemma-3-27b-pt_th1

Updated 1mo ago

Evaluation Results

Method	Links
gemma-3-27b-pt_th1 2026.04		69.753
codegemma-1.1-7b-it_th1 2026.04		64.625
codegemma-7b_th1 2026.04		64.435
Qwen2.5-Coder-14B_th1 2026.04		63.818
codegemma-7b 2026.04		59.628
Qwen2.5-Coder-7B 2026.04		57.799
CodeLlama-70b-hf_th1 2026.04		56.363
CodeLlama-70b-hf 2026.04		54.776
Qwen2.5-Coder-14B 2026.04		54.498
codegemma-1.1-7b-it 2026.04		54.183
Qwen2.5-Coder-32B 2026.04		51.694
random baseline 2026.04		50
Qwen2.5-Coder-0.5B 2026.04		49.474
gemma-3-27b-pt 2026.04		48.006
CodeBERT baseline 2026.04		30.53