Quantum latent distributions in deep generative models
Omar Bacarreza, Thorin Farnsworth, Alexander Makarovskiy, Hugo Wallner, Tessa Hicks, Santiago Sempere-Llagostera, John Price, Robert Francis-Jones, William Clements
Abstract
Many successful families of generative models leverage a low-dimensional latent distribution that is mapped to a data distribution. Though simple latent distributions are often used, the choice of distribution has a strong impact on model performance. Recent experiments have suggested that the probability distributions produced by quantum processors, which are typically highly correlated and classically intractable, can lead to improved performance on some datasets. However, when and why latent distributions produced by quantum processors can improve performance, and whether these improvements are connected to quantum properties of these distributions, are open questions that we investigate in this work. We show in theory that, under certain conditions, these "quantum latent distributions" enable generative models to produce data distributions that classical latent distributions cannot efficiently produce. We provide intuition as to the underlying mechanisms that could explain a performance advantage on real datasets. Based on this, we perform extensive benchmarking on a synthetic quantum dataset and the QM9 molecular dataset, using both simulated and real photonic quantum processors. We find that the statistics arising from quantum interference lead to improved generative performance compared to classical baselines, suggesting that quantum processors can play a role in expanding the capabilities of deep generative models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eadac502-8e3d-49b6-827b-485a290141bbBuilds on12
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- Tackling the Generative Learning Trilemma with Denoising Diffusion GANsZhisheng Xiao, Karsten Kreis, Arash VahdatICLR 2022 · 726 citations
- Flow Matching for Generative ModelingYaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel et al.ICLR 2023 · 87 citations
- Full-Atom Peptide Design based on Multi-modal Flow MatchingJiahan Li, Chaoran Cheng, Zuofan Wu, Ruihan Guo et al.ICML 2024 · 38 citations
Related papers
- Quantum 3D Graph Learning with Applications to Molecule EmbeddingGe Yan, Huaijin Wu, Junchi YanICML 2023 · 11 citations
- What Makes Data Suitable for a Locally Connected Neural Network? A Necessary and Sufficient Condition Based on Quantum EntanglementYotam Alexander, Nimrod De La Vega, Noam Razin, Nadav CohenNeurIPS 2023 · 8 citations
- QVAE-Mole: The Quantum VAE with Spherical Latent Variable Learning for 3-D Molecule GenerationHuaijin Wu, Xinyu Ye, Junchi YanNeurIPS 2024 · 25 citations
- Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule DesignJörg K. H. Franke, Frederic Runge, Frank HutterNeurIPS 2022 · 19 citations
- Scaling Up Probabilistic Circuits by Latent Variable DistillationAnji Liu, Honghua Zhang, Guy Van den BroeckICLR 2023 · 5 citations
