Collecting Self-reported Physical Activity and Posture Data Using Audio-based Ecological Momentary Assessment
Ha Le, Rithika Lakshminarayanan, Jixin Li, Varun Mishra, Stephen S. Intille
Abstract
μEMA is a data collection method that prompts research participants with quick, answer-at-a-glance, single-multiple-choice self-report behavioral questions, thus enabling high-temporal-density self-report of up to four times per hour when implemented on a smartwatch. However, due to the small watch screen, μEMA is better used to select among 2 to 5 multiple-choice answers versus allowing the collection of open-ended responses. We introduce an alternative and novel form of micro-interaction self-report using speech input - audio-μEMA- where a short beep or vibration cues participants to verbally report their behavioral states, allowing for open-ended, temporally dense self-reports. We conducted a one-hour usability study followed by a within-subject, 6-day to 21-day free-living feasibility study in which participants self-reported their physical activities and postures once every 2 to 5 minutes. We qualitatively explored the usability of the system and identified factors impacting the response rates of this data collection method. Despite being interrupted 12 to 20 times per hour, participants in the free-living study were highly engaged with the system, with an average response rate of 67.7% for audio-μEMA for up to 14 days. We discuss the factors that impacted feasibility; some implementation, methodological, and participant challenges we observed; and important considerations relevant to deploying audio-μEMA in real-time activity recognition systems.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get d1c52299-304d-4b40-afe2-8809cdad397fCited by top-tier papers2
- Feasibility and Utility of Multimodal Micro Ecological Momentary Assessment on a SmartwatchHa Le, Veronika Potter, Rithika Lakshminarayanan, Varun Mishra et al.CHI 2025 · 11 citations
- GLOSS: Group of LLMs for Open-ended Sensemaking of Passive Sensing Data for Health and WellbeingAkshat Choube, Ha Le, Jiachen Li, Kaixin Ji et al.UbiComp 2025 · 10 citations
Related papers
- Longitudinal User Engagement with Microinteraction Ecological Momentary Assessment (μEMA)Aditya Ponnada, Shirlene Wang, Jixin Li, Wei-Lin Wang et al.UbiComp 2025 · 4 citations
- Contextual Biases in Microinteraction Ecological Momentary Assessment (μEMA) Non-responseAditya Ponnada, Jixin Li, Shirlene Wang, Wei-Lin Wang et al.UbiComp 2022 · 19 citations
- Toward Lightweight In-situ Self-reporting: An Exploratory Study of Alternative Smartwatch Interface Designs in ContextXinghui (Erica) Yan, Shriti Raj, Bingjian Huang, Sun Young Park et al.UbiComp 2021 · 20 citations
- Ask Less, Learn More: Adapting Ecological Momentary Assessment Survey Length by Modeling Question-Answer Information GainJixin Li, Aditya Ponnada, Wei-Lin Wang, Genevieve F. Dunton et al.UbiComp 2025 · 13 citations
- Exploring Context-Aware Mental Health Self-Tracking Using Multimodal Smart Speakers in Home EnvironmentsJieun Lim, Youngji Koh, Auk Kim, Uichin LeeCHI 2024 · 29 citations
