Completing Missing Prevalence Rates for Multiple Chronic Diseases by Jointly Leveraging Both Intra- and Inter-Disease Population Health Data Correlations
Yujie Feng, Jiangtao Wang, Yasha Wang, Sumi Helal
Abstract
Population health data are becoming more and more publicly available on the Internet than ever before. Such datasets offer a great potential for enabling a better understanding of the health of populations, and inform health professionals and policy makers for better resource planning, disease management and prevention across different regions. However, due to the laborious and high-cost nature of collecting such public health data, it is a common place to find many missing entries on these datasets, which challenges the utility of the data and hinders reliable analysis and understanding. To tackle this problem, this paper proposes a deep-learning-based approach, called Compressive Population Health (CPH), to infer and recover (to complete) the missing prevalence rate entries of multiple chronic diseases. The key insight of CPH relies on the combined exploitation of both intra-disease and inter-disease correlation opportunities. Specifically, we first propose a Convolutional Neural Network (CNN) based approach to extract and model both of these two types of correlations, and then adopt a Generative Adversarial Network (GAN) based prevalence inference model to jointly fuse them to facility the prevalence rates data recovery of missing entries. We extensively evaluate the inference model based on real-world public health datasets publicly available on the Web. Results show that our inference method outperforms other baseline methods in various settings and with a significantly improved accuracy (from 14.8% to 9.1%).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dca1d058-9f99-44a4-a80a-311db877ee5bCited by top-tier papers5
- Distilling Knowledge from Publicly Available Online EMR Data to Emerging Epidemic for PrognosisLiantao Ma, Xinyu Ma, Junyi Gao, Xianfeng Jiao et al.WWW 2021 · 32 citations
- KerPrint: Local-Global Knowledge Graph Enhanced Diagnosis Prediction for Retrospective and Prospective InterpretationsKai Yang, Yongxin Xu, Peinie Zou, Hongxin Ding et al.AAAI 2023 · 29 citations
- Towards LLM-driven Dialogue State TrackingYujie Feng, Zexin Lu, Bo Liu, Liming Zhan et al.EMNLP 2023 · 25 citations
- SMART: Towards Pre-trained Missing-Aware Model for Patient Health Status PredictionZhihao Yu, Chu Xu, Yujie Jin, Yasha Wang et al.NeurIPS 2024 · 19 citations
- TaSL: Continual Dialog State Tracking via Task Skill Localization and ConsolidationYujie Feng, Xu Chu, Yongxin Xu, Guangyuan Shi et al.ACL 2024 · 1 citation
Builds on2
- ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare ContextLiantao Ma, Chaohe Zhang, Yasha Wang, Wenjie Ruan et al.AAAI 2020 · 190 citations
- AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and RecalibrationLiantao Ma, Junyi Gao, Yasha Wang, Chaohe Zhang et al.AAAI 2020 · 156 citations
Related papers
- GAMIN: Generative Adversarial Multiple Imputation Network for Highly Missing DataSeongwook Yoon, Sanghoon SullCVPR 2020
- Data-Free Knowledge Amalgamation via Group-Stack Dual-GANJingwen Ye, Yixin Ji, Xinchao Wang, Xin Gao et al.CVPR 2020
- Deep Human Dynamics PriorQiongjie Cui, Huaijiang Sun, Yue Kong, Xiaoning SunACM MM 2021 · 7 citations
- CONAN: Complementary Pattern Augmentation for Rare Disease DetectionLimeng Cui, Siddharth Biswal, Lucas M. Glass, Greg Lever et al.AAAI 2020 · 43 citations
- Meta-GAIN for Missing Data ImputationTao Tong, Xiaofeng Zhu, Jiangzhang GanAAAI 2026
