Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Knowledge Tracing Machines: Factorization Machines for Knowledge Tracing

About

Knowledge tracing is a sequence prediction problem where the goal is to predict the outcomes of students over questions as they are interacting with a learning platform. By tracking the evolution of the knowledge of some student, one can optimize instruction. Existing methods are either based on temporal latent variable models, or factor analysis with temporal features. We here show that factorization machines (FMs), a model for regression or classification, encompasses several existing models in the educational literature as special cases, notably additive factor model, performance factor model, and multidimensional item response theory. We show, using several real datasets of tens of thousands of users and items, that FMs can estimate student knowledge accurately and fast even when student data is sparsely observed, and handle side information such as multiple knowledge components and number of attempts at item or skill level. Our approach allows to fit student models of higher dimension than existing models, and provides a testbed to try new combinations of features in order to improve existing models.

Jill-J\^enn Vie, Hisashi Kashima• 2018

Related benchmarks

TaskDatasetResultRank
Knowledge TracingAssistments public benchmark 2009-2010
AUC0.75
35
Knowledge TracingEdNet
AUC0.6888
18
Knowledge TracingEdNet 1.0 (test)
AUC68.55
17
Knowledge TracingASSIST 2012-2013 (test)
AUC0.6948
9
Knowledge TracingASSIST12
AUC67.88
8
Showing 5 of 5 rows

Other info

Follow for update