Probabilistic Missing Value Imputation for Mixed Categorical and Ordered Data
Yuxuan Zhao, Alex Townsend, Madeleine Udell
Abstract
Many real-world datasets contain missing entries and mixed data types including categorical and ordered (e.g. continuous and ordinal) variables. Imputing the missing entries is necessary, since many data analysis pipelines require complete data, but this is challenging especially for mixed data. This paper proposes a probabilistic imputation method using an extended Gaussian copula model that supports both single and multiple imputation. This method models mixed categorical and ordered data using a latent Gaussian distribution. The unordered characteristics of categorical variables is explicitly modeled using the argmax operator. This model makes no assumptions on the data marginals nor does it require any hyperparameter. Experimental results on synthetic and real datasets show that imputation with the extended Gaussian copula outperforms the current state-of-the-art for both categorical and ordered variables in mixed data. Preprint. Under review.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5e7a1bf8-d220-441b-a784-76e71d1a862cCited by top-tier papers1
Ask how each one uses itBuilds on4
- Missing Value Imputation for Mixed Data via Gaussian CopulaYuxuan Zhao, Madeleine UdellKDD 2020 · 53 citations
- AutoML Pipeline Selection: Efficiently Navigating the Combinatorial SpaceChengrun Yang, Jicong Fan, Ziyang Wu, Madeleine UdellKDD 2020 · 29 citations
- Matrix Completion with Quantified Uncertainty through Low Rank Gaussian CopulaYuxuan Zhao, Madeleine UdellNeurIPS 2020 · 28 citations
- Online Missing Value Imputation and Change Point Detection with the Gaussian CopulaYuxuan Zhao, Eric Landgrebe, Eliot Shekhtman, Madeleine UdellAAAI 2022 · 12 citations
Related papers
- Gaussian Copula EmbeddingsChien Lu, Jaakko PeltonenNeurIPS 2022 · 1 citation
- Probabilistic Imputation for Time-series Classification with Missing DataSeunghyun Kim, Hyunsu Kim, Eunggu Yun, Hwangrae Lee et al.ICML 2023 · 37 citations
- Identifiable Generative models for Missing Not at Random Data ImputationChao Ma, Cheng ZhangNeurIPS 2021 · 56 citations
- Missing Data Imputation and Acquisition with Deep Hierarchical Models and Hamiltonian Monte CarloIgnacio Peis, Chao Ma, José Miguel Hernández-LobatoNeurIPS 2022 · 25 citations
- VAEM: a Deep Generative Model for Heterogeneous Mixed Type DataChao Ma, Sebastian Tschiatschek, Richard E. Turner, José Miguel Hernández-Lobato et al.NeurIPS 2020 · 105 citations
