Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data
Paul Pu Liang, Terrance Liu, Anna Cai, Michal Muszynski, Ryo Ishii, Nicholas B. Allen, Randy Auerbach, David Brent, Ruslan Salakhutdinov, Louis-Philippe Morency
Abstract
Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications for the early detection, intervention, and treatment of mental health disorders. One promising data source to help monitor human behavior is daily smartphone usage. However, care must be taken to summarize behaviors without identifying the user through personal (e.g., personally identifiable information) or protected (e.g., race, gender) attributes. In this paper, we study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors. Using computational models, we find that language and multimodal representations of mobile typed text (spanning typed characters, words, keystroke timings, and app usage) are predictive of daily mood. However, we find that models trained to predict mood often also capture private user identities in their intermediate representations. To tackle this problem, we evaluate approaches that obfuscate user identity while remaining predictive. By combining multimodal representations with privacy-preserving learning, we are able to push forward the performanceprivacy frontier.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3bb95619-4259-4250-9125-b95df344fb2eCited by top-tier papers1
Ask how each one uses itBuilds on2
Related papers
- Smartphone-derived Virtual Keyboard Dynamics Coupled with Accelerometer Data as a Window into Understanding Brain Health: Smartphone Keyboard and Accelerometer as Window into Brain HealthEmma Ning, Andrea T. Cladek, Mindy K. Ross, Sarah Kabir et al.CHI 2023 · 18 citations
- Privacy Enhanced Multimodal Neural Representations for Emotion RecognitionMimansa Jaiswal, Emily Mower ProvostAAAI 2020 · 90 citations
- Leveraging Collaborative-Filtering for Personalized Behavior Modeling: A Case Study of Depression Detection among College StudentsXuhai Xu, Prerna Chikersal, Janine M. Dutcher, Yasaman S. Sefidgar et al.UbiComp 2021 · 75 citations
- StudentSADD: Rapid Mobile Depression and Suicidal Ideation Screening of College Students during the Coronavirus PandemicM. L. Tlachac, Ricardo Flores, Miranda Reisch, Rimsha Kayastha et al.UbiComp 2022 · 20 citations
- GLOBEM: Cross-Dataset Generalization of Longitudinal Human Behavior ModelingXuhai Xu, Xin Liu, Han Zhang, Weichen Wang et al.UbiComp 2023 · 96 citations
