Lune

EMNLP Findings2021

Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Health

Andrew Lee, Jonathan K. Kummerfeld, Larry An, Rada Mihalcea

Abstract

Many statistical models have high accuracy on test benchmarks, but are not explainable, struggle in low-resource scenarios, cannot be reused for multiple tasks, and cannot easily integrate domain expertise. These factors limit their use, particularly in settings such as mental health, where it is difficult to annotate datasets and model outputs have significant impact. We introduce a micromodel architecture to address these challenges. Our approach allows researchers to build interpretable representations that embed domain knowledge and provide explanations throughout the model's decision process. We demonstrate the idea on multiple mental health tasks: depression classification, PTSD classification, and suicidal risk assessment. Our systems consistently produce strong results, even in low-resource scenarios, and are more interpretable than alternative methods.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 4 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers4

  1. Improving the Generalizability of Depression Detection by Leveraging Clinical QuestionnairesThong Nguyen, Andrew Yates, Ayah Zirikly, Bart Desmet et al.ACL 2022 · 66 citations
  2. Symptom Identification for Interpretable Detection of Multiple Mental Disorders on Social MediaZhiling Zhang, Siyuan Chen, Mengyue Wu, Kenny Q. ZhuEMNLP 2022 · 15 citations
  3. Detection of Multiple Mental Disorders from Social Media with Two-Stream Psychiatric ExpertsSiyuan Chen, Zhiling Zhang, Mengyue Wu, Kenny Q. ZhuEMNLP 2023 · 7 citations
  4. Responsible Evaluation of AI for Mental HealthHiba Arnaout, Anmol Goel, H. Andrew Schwartz, Steffen Eberhardt et al.ACL 2026

Builds on5

  1. K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang et al.AAAI 2020 · 898 citations
  2. Investigating Gender Bias in Language Models Using Causal Mediation AnalysisJesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian et al.NeurIPS 2020 · 851 citations
  3. Do Models of Mental Health Based on Social Media Data Generalize?Keith Harrigian, Carlos Alejandro Aguirre, Mark DredzeEMNLP Findings 2020 · 45 citations
  4. More Diverse Dialogue Datasets via Diversity-Informed Data CollectionKatherine Stasaski, Grace Hui Yang, Marti A. HearstACL 2020 · 16 citations
  5. Finding Universal Grammatical Relations in Multilingual BERTEthan A. Chi, John Hewitt, Christopher D. ManningACL 2020 · 7 citations

Related papers

  1. A Simple and Flexible Modeling for Mental Disorder Detection by Learning from Clinical QuestionnairesHoyun Song, Jisu Shin, Huije Lee, Jong C. ParkACL 2023
  2. ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor DataXinzhe Zheng, Sijie Ji, Jiawei Sun, Renqi Chen et al.ACL Findings 2025 · 6 citations
  3. MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social MediaWei Zhai, Nan Bai, Qing Zhao, Jianqiang Li et al.EMNLP 2025
  4. MAGI: Multi-Agent Guided Interview for Psychiatric AssessmentGuanqun Bi, Zhuang Chen, Zhoufu Liu, Hongkai Wang et al.ACL Findings 2025 · 5 citations
  5. LLM Questionnaire Completion for Automatic Psychiatric AssessmentGony Rosenman, Talma Hendler, Lior WolfEMNLP Findings 2024 · 12 citations
Dusk over the sea between two cliffs drawn in fine vertical lines