PREFAB: PREFerence-based Affective Modeling for Low-Budget Self-Annotation
JaeYoung Moon, Youjin Choi, Yucheon Park, David Melhart, Georgios N. Yannakakis, Kyung-Joong Kim
Abstract
Self-annotation is the gold standard for collecting affective state labels in affective computing. Existing methods typically rely on full annotation, requiring users to continuously label affective states across entire sessions. While this process yields fine-grained data, it is time-consuming, cognitively demanding, and prone to fatigue and errors. To address these issues, we present PREFAB, a low-budget retrospective self-annotation method that targets affective inflection regions rather than full annotation. Grounded in the peak-end rule and ordinal representations of emotion, PREFAB employs a preference learning model to detect relative affective changes, directing annotators to label only selected segments while interpolating the remainder of the stimulus. We further introduce a preview mechanism that provides brief contextual cues to assist annotation. We evaluate PREFAB through a technical performance study and a 25-participant user study. Results show that PREFAB outperforms baselines in modeling affective inflections while mitigating workload (and conditionally mitigating temporal burden). Importantly, PREFAB improves annotator confidence without degrading annotation quality.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on7
- KnitUI: Fabricating Interactive and Sensing Textiles with Machine KnittingYiyue Luo, Kui Wu, Tomás Palacios, Wojciech MatusikCHI 2021 · 101 citations
- RCEA: Real-time, Continuous Emotion Annotation for Collecting Precise Mobile Video Ground Truth LabelsTianyi Zhang, Abdallah El Ali, Chen Wang, Alan Hanjalic et al.CHI 2020 · 51 citations
- Improving Multi-Task Generalization via Regularizing Spurious CorrelationZiniu Hu, Zhe Zhao, Xinyang Yi, Tiansheng Yao et al.NeurIPS 2022 · 46 citations
- Functional Regularization for Representation Learning: A Unified Theoretical PerspectiveSiddhant Garg, Yingyu LiangNeurIPS 2020 · 27 citations
- RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual RealityDominic Potts, Miloni Gada, Aastha Gupta, Kavya Goel et al.CHI 2025 · 9 citations
Related papers
- AffectFAL: Federated Active Affective Computing with Non-IID DataZixin Zhang, Fan Qi, Shuai Li, Changsheng XuACM MM 2023 · 8 citations
- Towards Reducing Continuous Emotion Annotation Effort During Video Consumption: A Physiological Response Profiling ApproachSwarnali Banik, Sougata Sen, Snehanshu Saha, Surjya GhoshUbiComp 2024 · 6 citations
- Towards Efficient Emotion Self-report Collection Using Human-AI Collaboration: A Case Study on Smartphone Keyboard InteractionPrajwal Melath, Ayush Raj, Sougata Sen, Snehanshu Saha et al.UbiComp 2023 · 7 citations
- Annotation-Efficient Language Model Alignment via Diverse and Representative Response TextsYuu Jinnai, Ukyo HondaEMNLP Findings 2025
- Simulating Emotions With an Integrated Computational Model of Appraisal and Reinforcement LearningJiayi Eurus Zhang, Bernhard Hilpert, Joost Broekens, Jussi P. P. JokinenCHI 2024 · 8 citations
