Social-Emotional-Sensory Design Map for Affective Computing Informed by Neurodivergent Experiences
Annuska Zolyomi, Jaime Snyder
Abstract
One of the grand challenges of artificial intelligence and affective computing is for technology to become emotionally-aware and thus, more human-like. Modeling human emotions is particularly complicated when we consider the lived experiences of people who are on the autism spectrum. To understand the emotional experiences of autistic adults and their attitudes towards common representations of emotions, we deployed a context study as the first phase of a Grounded Design research project. Based on community observations and interviews, this work contributes empirical evidence of how the emotional experiences of autistic adults are entangled with social interactions as well as the processing of sensory inputs. We learned that (1) the emotional experiences of autistic adults are embodied and co-constructed within the context of physical environments, social relationships, and technology use, and (2) conventional approaches to visually representing emotion in affective education and computing systems fail to accurately represent the experiences and perceptions of autistic adults. We contribute a social-emotional-sensory design map to guide designers in creating more diverse and nuanced affective computing interfaces that are enriched by accounting for neurodivergent users.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0bd16007-34b9-4aee-80df-2901ccafba12Cited by top-tier papers6
- "My Perfect Platform Would Be Telepathy" - Reimagining the Design of Social Media with Autistic AdultsBelén Barros Pena, Nelya Koteyko, Martine Van Driel, Andrea Delgado et al.CHI 2023 · 35 citations
- Are Robots Ready to Deliver Autism Inclusion?: A Critical ReviewNaba Rizvi, William Wu, Mya Bolds, Raunak Mondal et al.CHI 2024 · 29 citations
- Perceiving Affordances Differently: The Unintended Consequences When Young Autistic Adults Engage with Social MediaXinru Page, Andrew Capener, Spring Cullen, Tao Wang et al.CHI 2022 · 24 citations
- Toward Language Justice: Exploring Multilingual Captioning for AccessibilityAashaka Desai, Rahaf Alharbi, Stacy Hsueh, Richard E. Ladner et al.CHI 2025 · 11 citations
- Inclusive Emotion Technologies: Addressing the Needs of d/Deaf and Hard of Hearing Learners in Video-Based LearningSi Chen, Jason Situ, Haocong Cheng, Suzy Su et al.CSCW 2025 · 6 citations
Builds on3
- The Human in Emotion Recognition on Social Media: Attitudes, Outcomes, RisksNazanin Andalibi, Justin BussCHI 2020 · 118 citations
- Optimizing for Happiness and Productivity: Modeling Opportune Moments for Transitions and Breaks at WorkHarmanpreet Kaur, Alex C. Williams, Daniel McDuff, Mary Czerwinski et al.CHI 2020 · 83 citations
- Affective State Prediction Based on Semi-Supervised Learning from Smartphone Touch DataRafael Wampfler, Severin Klingler, Barbara Solenthaler, Victor R. Schinazi et al.CHI 2020 · 29 citations
Related papers
- An Emotion Translator: Speculative Design By Neurodiverse DyadsAnnuska Zolyomi, Jaime SnyderCHI 2024 · 30 citations
- Autistic Adults' Perspectives on Self-Expression and Dyadic vs. Group Interactions in AR TelepresenceMahrukh Tauseef, Alexandra Watkins, Zalen Ingram, Rendong Zhang et al.CHI 2026
- Navigating Financial Lives: How Autistic Adults Adapt Financial Technologies, Tools and StrategiesHelena Lyhme, Belén Barros Pena, Stephanie WilsonCHI 2026 · 2 citations
- Designing for Common Ground: Visually Representing Conversation Dynamics of Neurodiverse DyadsAnnuska Zolyomi, Jaime SnyderCSCW 2023 · 23 citations
- Exploring Autistic Coping through Participatory DesignBelén Barros Pena, John Vines, Martine Van Driel, Nelya KoteykoCSCW 2025 · 1 citation
