Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Dynamic Key-Value Memory Networks for Knowledge Tracing

About

Knowledge Tracing (KT) is a task of tracing evolving knowledge state of students with respect to one or more concepts as they engage in a sequence of learning activities. One important purpose of KT is to personalize the practice sequence to help students learn knowledge concepts efficiently. However, existing methods such as Bayesian Knowledge Tracing and Deep Knowledge Tracing either model knowledge state for each predefined concept separately or fail to pinpoint exactly which concepts a student is good at or unfamiliar with. To solve these problems, this work introduces a new model called Dynamic Key-Value Memory Networks (DKVMN) that can exploit the relationships between underlying concepts and directly output a student's mastery level of each concept. Unlike standard memory-augmented neural networks that facilitate a single memory matrix or two static memory matrices, our model has one static matrix called key, which stores the knowledge concepts and the other dynamic matrix called value, which stores and updates the mastery levels of corresponding concepts. Experiments show that our model consistently outperforms the state-of-the-art model in a range of KT datasets. Moreover, the DKVMN model can automatically discover underlying concepts of exercises typically performed by human annotations and depict the changing knowledge state of a student.

Jiani Zhang, Xingjian Shi, Irwin King, Dit-Yan Yeung• 2016

Related benchmarks

TaskDatasetResultRank
Knowledge TracingAssistments public benchmark 2009-2010
AUC0.7897
35
Knowledge TracingKT-PSP-25 1.0 (test)
AUC60.49
30
Knowledge TracingJunyi
ACC81.41
24
Knowledge TracingDBE-KT22 (test)
AUC78.3
21
Knowledge TracingEdNet-500 (test)
AUC0.78
21
Knowledge TracingASSIST09 (test)
AUC71.99
21
Knowledge TracingEdNet
AUC0.6967
18
Knowledge TracingEdNet 1.0 (test)
AUC68.93
17
Knowledge TracingmilkT (test)
ACC Wrong43.5
16
Knowledge TracingStatics 2011
Accuracy78.29
14
Showing 10 of 19 rows

Other info

Follow for update