Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Breaking Robustness Barriers in Cognitive Diagnosis: A One-Shot Neural Architecture Search Perspective

About

With the advancement of network technologies, intelligent tutoring systems (ITS) have emerged to deliver increasingly precise and tailored personalized learning services. Cognitive diagnosis (CD) has emerged as a core research task in ITS, aiming to infer learners' mastery of specific knowledge concepts by modeling the mapping between learning behavior data and knowledge states. However, existing research prioritizes model performance enhancement while neglecting the pervasive noise contamination in observed response data, significantly hindering practical deployment. Furthermore, current cognitive diagnosis models (CDMs) rely heavily on researchers' domain expertise for structural design, which fails to exhaustively explore architectural possibilities, thus leaving model architectures' full potential untapped. To address this issue, we propose OSCD, an evolutionary multi-objective One-Shot neural architecture search method for Cognitive Diagnosis, designed to efficiently and robustly improve the model's capability in assessing learner proficiency. Specifically, OSCD operates through two distinct stages: training and searching. During the training stage, we construct a search space encompassing diverse architectural combinations and train a weight-sharing supernet represented via the complete binary tree topology, enabling comprehensive exploration of potential architectures beyond manual design priors. In the searching stage, we formulate the optimal architecture search under heterogeneous noise scenarios as a multi-objective optimization problem (MOP), and develop an optimization framework integrating a Pareto-optimal solution search strategy with cross-scenario performance evaluation for resolution. Extensive experiments on real-world educational datasets validate the effectiveness and robustness of the optimal architectures discovered by our OSCD model for CD tasks.

Ziwen Wang, Shangshang Yang, Xiaoshan Yu, Haiping Ma, Xingyi Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Cognitive DiagnosisASSIST09 (60%/20%/20%)
Accuracy73.03
18
Cognitive DiagnosisASSIST09 (70%/10%/20%)
Accuracy73.41
18
Cognitive DiagnosisSLP-Math (50%/20%/30%)
ACC0.7868
18
Cognitive DiagnosisSLP-Math (60% 20% 20%)
ACC78.73
18
Cognitive DiagnosisSLP-Math (80%/10%/10%)
Accuracy79.06
18
Learner Performance PredictionSLP-Math
Log Miss (10%) AUC Change Ratio-0.0014
18
Cognitive DiagnosisASSIST09 (50%/20%/30%)
ACC0.7242
18
Cognitive DiagnosisASSIST09 (80%/10%/10%)
Accuracy73.45
18
Cognitive DiagnosisSLP-Math (70%/10%/20%)
Acc79.29
18
Learner Performance PredictionSLP-Math
Time Cost51.7
12
Showing 10 of 11 rows

Other info

Follow for update