Covariate-moderated Empirical Bayes Matrix Factorization
William R. P. Denault, Karl Tayeb, Peter Carbonetto, Jason Willwerscheid, Matthew Stephens
Abstract
Matrix factorization is a fundamental method in statistics and machine learning for inferring and summarizing structure in multivariate data. Modern data sets often come with “side information” of various forms (images, text, graphs) that can be leveraged to improve estimation of the underlying structure. However, existing methods that leverage side information are limited in the types of data they can incorporate, and they assume specific parametric models. Here, we introduce a novel method for this problem, covariate-moderated empirical Bayes matrix factorization (cEBMF). cEBMF is a modular framework that accepts any type of side information that is processable by a probabilistic model or a neural network. The cEBMF framework can accommodate different assumptions and constraints on the factors through the use of different priors, and it adapts these priors to the data. We demonstrate the benefits of cEBMF in simulations and in analyses of spatial transcriptomics and collaborative filtering data. A PyTorch-based implementation of cEBMF with flexible priors is available at https://github.com/william-denault/cebmf_torch.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Related papers
- Multilayer Matrix Factorization via Dimension-Reducing Diffusion Variational InferenceJunbin Liu, Farzan Farnia, Wing-Kin MaICML 2025
- An iterative clustering algorithm for the Contextual Stochastic Block Model with optimality guaranteesGuillaume Braun, Hemant Tyagi, Christophe BiernackiICML 2022 · 16 citations
- A Topic-aware Summarization Framework with Different Modal Side InformationXiuying Chen, Mingzhe Li, Shen Gao, Xin Cheng et al.SIGIR 2023 · 10 citations
- Alleviating Cold-start Problem in CTR Prediction with A Variational Embedding Learning FrameworkXiaoxiao Xu, Chen Yang, Qian Yu, Zhiwei Fang et al.WWW 2022 · 41 citations
- Deep Multi-Modal Structural Equations For Causal Effect Estimation With Unstructured ProxiesShachi Deshpande, Kaiwen Wang, Dhruv Sreenivas, Zheng Li et al.NeurIPS 2022 · 15 citations
