Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PREFAB: PREFerence-based Affective Modeling for Low-Budget Self-Annotation

About

Self-annotation is the gold standard for collecting affective state labels in affective computing. Existing methods typically rely on full annotation, requiring users to continuously label affective states across entire sessions. While this process yields fine-grained data, it is time-consuming, cognitively demanding, and prone to fatigue and errors. To address these issues, we present PREFAB, a low-budget retrospective self-annotation method that targets affective inflection regions rather than full annotation. Grounded in the peak-end rule and ordinal representations of emotion, PREFAB employs a preference-learning model to detect relative affective changes, directing annotators to label only selected segments while interpolating the remainder of the stimulus. We further introduce a preview mechanism that provides brief contextual cues to assist annotation. We evaluate PREFAB through a technical performance study and a 25-participant user study. Results show that PREFAB outperforms baselines in modeling affective inflections while mitigating workload (and conditionally mitigating temporal burden). Importantly PREFAB improves annotator confidence without degrading annotation quality.

Jaeyoung Moon, Youjin Choi, Yucheon Park, David Melhart, Georgios N. Yannakakis, Kyung-Joong Kim• 2026

Related benchmarks

TaskDatasetResultRank
Game performance evaluationApex
F1 Score64.8
5
Game performance evaluationEndless
F1 Score63.5
5
Game performance evaluationHeist!
F1 Score63.7
5
Game performance evaluationPirates!
F1 Score68.5
5
Game performance evaluationRun'N'Gun
F1 Score68.1
5
Game performance evaluationShootout
F1 Score65.6
5
Game performance evaluationSolid
F1 Score0.632
5
Game performance evaluationTinyCars
F1 Score63.4
5
Game performance evaluationTopDown
F1 Score66.3
5
Showing 9 of 9 rows

Other info

Follow for update