Lune

IEEE VIS2020Top-tier venue

Humane Visual AI: Telling the Stories Behind a Medical Condition

Wonyoung So, Edyta Paulina Bogucka, Sanja Scepanovic, Sagar Joglekar, Ke Zhou, Daniele Quercia

Abstract

A biological understanding is key for managing medical conditions, yet psychological and social aspects matter too. The main problem is that these two aspects are hard to quantify and inherently difficult to communicate. To quantify psychological aspects, this work mined around half a million Reddit posts in the sub-communities specialised in 14 medical conditions, and it did so with a new deep-learning framework. In so doing, it was able to associate mentions of medical conditions with those of emotions. To then quantify social aspects, this work designed a probabilistic approach that mines open prescription data from the National Health Service in England to compute the prevalence of drug prescriptions, and to relate such a prevalence to census data. To finally visually communicate each medical condition's biological, psychological, and social aspects through storytelling, we designed a narrative-style layered Martini Glass visualization. In a user study involving 52 participants, after interacting with our visualization, a considerable number of them changed their mind on previously held opinions: 10% gave more importance to the psychological aspects of medical conditions, and 27% were more favourable to the use of social media data in healthcare, suggesting the importance of persuasive elements in interactive visualizations.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Related papers

  1. Dialogue Medical Information Extraction with Medical-Item Graph and Dialogue-Status Enriched RepresentationLei Gao, Xinnan Zhang, Xian Wu, Shen Ge et al.EMNLP Findings 2023 · 3 citations
  2. Discussing Social Media During Psychotherapy Consultations: Patient Narratives and Privacy ImplicationsDong Whi Yoo, Aditi Bhatnagar, Sindhu Kiranmai Ernala, Asra Ali et al.CSCW 2023 · 11 citations
  3. MIND: Empowering Mental Health Clinicians with Multimodal Data Insights through a Narrative DashboardRuishi Zou, Shiyu Xu, Margaret E. Morris, Jihan Ryu et al.CHI 2026 · 2 citations
  4. Detecting Users' Emotional States during Passive Social Media UseChristoph Gebhardt, Andreas Brombach, Tiffany Luong, Otmar Hilliges et al.UbiComp 2024 · 8 citations
  5. Deconstructing Depression Stigma: Integrating AI-driven Data Collection and Analysis with Causal Knowledge GraphsHan Meng, Renwen Zhang, Ganyi Wang, Yitian Yang et al.CHI 2025 · 6 citations
Dusk over the sea between two cliffs drawn in fine vertical lines