Relative Entropy Estimation in Function Space: Theory and Applications to Trajectory Inference
CHAO WANG, Luca Nepote, Giulio Franzese, Pietro Michiardi
Abstract
Trajectory Inference (TI) seeks to recover latent dynamical processes from snapshot data, where only independent samples from time-indexed marginals are observed. In applications such as single-cell genomics, destructive measurements make path-space laws non-identifiable from finitely many marginals, leaving held-out marginal prediction as the dominant but limited evaluation protocol. We introduce a general framework for estimating the Kullback–Leibler divergence (KL) between probability measures on function space, yielding a tractable, data-driven estimator that is scalable to realistic snapshot datasets. We validate the accuracy of our estimator on a benchmark suite, where the estimated functional KL closely matches the analytic KL. Applying this framework to synthetic and real scRNA-seq datasets, we show that current evaluation metrics often give inconsistent assessments, whereas path-space KL enables a coherent comparison of trajectory inference methods and exposes discrepancies in inferred dynamics, especially in regions with sparse or missing data. These results support functional KL as a principled criterion for evaluating trajectory inference under partial observability. Code available here: https://github.com/eurecom-probai/functional-kl.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b9b9d9a0-27aa-4285-9adf-01d9d1034d42Builds on16
- TrajectoryNet: A Dynamic Optimal Transport Network for Modeling Cellular DynamicsAlexander Tong, Jessie Huang, Guy Wolf, David van Dijk et al.ICML 2020 · 257 citations
- Likelihood Training of Schrödinger Bridge using Forward-Backward SDEs TheoryTianrong Chen, Guan-Horng Liu, Evangelos A. TheodorouICLR 2022 · 249 citations
- Diffusion Schrödinger Bridge MatchingYuyang Shi, Valentin De Bortoli, Andrew Campbell, Arnaud DoucetNeurIPS 2023 · 178 citations
- Manifold Interpolating Optimal-Transport Flows for Trajectory InferenceGuillaume Huguet, Daniel Sumner Magruder, Alexander Tong, Oluwadamilola Fasina et al.NeurIPS 2022 · 126 citations
- Action Matching: Learning Stochastic Dynamics from SamplesKirill Neklyudov, Rob Brekelmans, Daniel Severo, Alireza MakhzaniICML 2023 · 83 citations
Related papers
- CellBRIDGE: Learning Cellular Trajectories via Interaction-Aware AlignmentSilas Ruhrberg Estevez, Nicolas Huynh, Tennison Liu, Roderik Kortlever et al.ICML 2026
- Trajectory Inference via Mean-field Langevin in Path SpaceLénaïc Chizat, Stephen Zhang, Matthieu Heitz, Geoffrey SchiebingerNeurIPS 2022 · 45 citations
- Clustering by Denoising: Latent plug-and-play diffusion for single-cell embeddingsDominik Meier, Shixing Yu, Sagnik Nandy, Promit Ghosal et al.ICLR 2026
- Approximating mutual information of high-dimensional variables using learned representationsGokul Gowri, Xiao-Kang Lun, Allon M. Klein, Peng YinNeurIPS 2024 · 35 citations
- Partially Observed Trajectory Inference using Optimal Transport and a Dynamics PriorAnming Gu, Edward Chien, Kristjan H. GreenewaldICLR 2025
