Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Dream at SemEval-2026 Task 13: SALSA for Single-Pass Machine-Generated Code Detection

About

Large language models have transformed code generation, raising concerns around authorship, assessment integrity, and software trust. SemEval-2026 Task 13 Subtask A operationalizes detection as binary classification over code snippets, with a particular emphasis on out-of-distribution (OOD) generalization across unseen programming languages and application domains. We propose a SALSA-style formulation, Single-pass Autoregressive LLM Structured Classification, that maps each class to a dedicated output token and trains the model to emit a single-token label in a structured response. Rather than engineering hand-crafted features or decision rules, this formulation delegates the authorship decision to the model. To improve OOD robustness, we combine balanced sampling across languages with parameter-efficient fine-tuning and conservative training (low learning rate, single epoch) to avoid overfitting to the training domain. Our best system achieves OOD $F_1 = 0.789$ on the official leaderboard, substantially outperforming the CodeBERT baseline ($F_1 = 0.305$).

Ruslan Berdichevsky, Shai Nahum-Gefen, Elad Ben-Zaken• 2026

Related benchmarks

TaskDatasetResultRank
Machine-generated code detectionSemEval Task 13 Subtask A 2026 official (test)
Macro F178.9
24
Machine-generated code detectionSemEval Task 13 Subtask A 2026 Official Kaggle (val)
Macro F199.6
8
Machine-generated code detectionSemEval-2026 Task 13 Subtask A (train)
Macro F199.6
8
Showing 3 of 3 rows

Other info

Follow for update