CodeWorkout
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Knowledge Estimation | CodeWorkout | Accuracy72.32 | 49 | |
| Code Similarity | CodeWorkout (5-fold averaged) | CodeBLEU0.593 | 49 | |
| Computerized Adaptive Testing | CodeWorkout (test) | Exp.% (med)41.4 | 7 | |
| Knowledge Tracing | CodeWorkout (test) | A1 Performance Score82.4 | 4 | |
| Predictive Modeling (AFM) | CodeWorkout Selected KC set (test) | AUC63.1 | 3 | |
| Predictive Modeling (AFM) | CodeWorkout Generated KC set (test) | AUC0.676 | 3 | |
| Predictive Modeling (AFM) | CodeWorkout Human KC set (test) | AUC66.5 | 3 | |
| Learning Curve fit | CodeWorkout Selected KC set (test) | RMSE0.069 | 3 | |
| Learning Curve fit | CodeWorkout Generated KC set (test) | RMSE0.07 | 3 | |
| Learning Curve fit | CodeWorkout Human KC set (test) | RMSE0.077 | 3 |
Showing 10 of 10 rows