PREFAB: PREFerence-based Affective Modeling for Low-Budget Self-Annotation
JaeYoung Moon, Youjin Choi, Yucheon Park, David Melhart, Georgios N. Yannakakis, Kyung-Joong Kim
Abstract
Self-annotation is the gold standard for collecting affective state labels in affective computing. Existing methods typically rely on full annotation, requiring users to continuously label affective states across entire sessions. While this process yields fine-grained data, it is time-consuming, cognitively demanding, and prone to fatigue and errors. To address these issues, we present PREFAB, a low-budget retrospective self-annotation method that targets affective inflection regions rather than full annotation. Grounded in the peak-end rule and ordinal representations of emotion, PREFAB employs a preference learning model to detect relative affective changes, directing annotators to label only selected segments while interpolating the remainder of the stimulus. We further introduce a preview mechanism that provides brief contextual cues to assist annotation. We evaluate PREFAB through a technical performance study and a 25-participant user study. Results show that PREFAB outperforms baselines in modeling affective inflections while mitigating workload (and conditionally mitigating temporal burden). Importantly, PREFAB improves annotator confidence without degrading annotation quality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a568343a-2ac1-4c6d-a392-6acbf0cdeedeBuilds on7
- KnitUI: Fabricating Interactive and Sensing Textiles with Machine KnittingYiyue Luo, Kui Wu, Tomás Palacios, Wojciech MatusikCHI 2021 · 101 citations
- RCEA: Real-time, Continuous Emotion Annotation for Collecting Precise Mobile Video Ground Truth LabelsTianyi Zhang, Abdallah El Ali, Chen Wang, Alan Hanjalic et al.CHI 2020 · 51 citations
- Improving Multi-Task Generalization via Regularizing Spurious CorrelationZiniu Hu, Zhe Zhao, Xinyang Yi, Tiansheng Yao et al.NeurIPS 2022 · 46 citations
- Functional Regularization for Representation Learning: A Unified Theoretical PerspectiveSiddhant Garg, Yingyu LiangNeurIPS 2020 · 27 citations
- RetroSketch: A Retrospective Method for Measuring Emotions and Presence in Virtual RealityDominic Potts, Miloni Gada, Aastha Gupta, Kavya Goel et al.CHI 2025 · 9 citations
Related papers
- AffectFAL: Federated Active Affective Computing with Non-IID DataZixin Zhang, Fan Qi, Shuai Li, Changsheng XuACM MM 2023 · 8 citations
- Towards Reducing Continuous Emotion Annotation Effort During Video Consumption: A Physiological Response Profiling ApproachSwarnali Banik, Sougata Sen, Snehanshu Saha, Surjya GhoshUbiComp 2024 · 6 citations
- Towards Efficient Emotion Self-report Collection Using Human-AI Collaboration: A Case Study on Smartphone Keyboard InteractionPrajwal Melath, Ayush Raj, Sougata Sen, Snehanshu Saha et al.UbiComp 2023 · 7 citations
- Simulating Emotions With an Integrated Computational Model of Appraisal and Reinforcement LearningJiayi Eurus Zhang, Bernhard Hilpert, Joost Broekens, Jussi P. P. JokinenCHI 2024 · 8 citations
- Toward Reliable Emotion Recognition: Alleviating Label Noise and Reducing Uncertain PredictionChengzhe Wang, Wenqing Ji, Chenyang Li, Tongjie Pan et al.ACM MM 2025
