Flow Straight and Fast in Hilbert Space: Functional Rectified Flow
Jianxin Zhang, Clayton Scott
摘要
Many generative models originally developed in finite-dimensional Euclidean space have functional generalizations in infinite-dimensional settings. However, the extension of rectified flow to infinite-dimensional spaces remains unexplored. In this work, we establish a rigorous functional formulation of rectified flow in an infinite-dimensional Hilbert space. Our approach builds upon the superposition principle for continuity equations in an infinite-dimensional space. We further show that this framework extends naturally to functional flow matching and functional probability flow ODEs, interpreting them as nonlinear generalizations of rectified flow. Notably, our extension to functional flow matching removes the restrictive measure-theoretic assumptions in the existing theory of Kerrigan et al. [37]. Furthermore, we demonstrate experimentally that our method achieves superior performance compared to existing functional generative models. Related work Generative models have significantly advanced in recent years, with methods such as Generative Adversarial Networks (GANs), diffusion models, and flow matching achieving state-of-the-art results. GANs, introduced in Goodfellow et al. [23] , leverage adversarial training to generate high-quality samples from complex data distributions. Diffusion models, based on stochastic differential equations, iteratively remove noise from corrupted data through a learned denoising process, demonstrating strong generative capabilities [31, 74] . Flow matching constructs a path of conditional Gaussian distributions to interpolate the data distribution and a reference distribution [50, 8] . Rectified flows, introduced by Liu et al. [56] , offer a deterministic alternative to stochastic generative models by constructing straight transport paths between source and target distributions. In contrast to diffusion models, which rely on stochastic sampling, rectified flows enable more efficient and interpretable generation with reduced computational overhead. The associated straightening effect has been shown to facilitate high-quality generation with very few sampling steps [45] . Further theoretical development, such as its connection to Optimal Transport, has been explored in Liu [54] . Recent advances have extended rectified flow methods to a broad range of generative tasks, including image generation and editing [83, 69, 59, 79, 14] , 3D content creation [21] , text-to-speech synthesis and editing [25, 52, 26, 80] , audio reconstruction [81, 53] , video generation [78], and multi-modal generative modeling [46, 51] . Despite this growing popularity, existing rectified flow models are still constrained to finite-dimensional spaces. In this work, we address this limitation by extending rectified flow to general Hilbert spaces, thereby enabling modeling in infinite-dimensional function spaces. A key motivation for studying functional generative models is that many data sources are inherently functional-such as snapshots of time series or solutions to partial differential equations. A prominent example is neural stochastic differential equations (Neural SDEs), where neural networks are trained to model path-valued random variables that solve SDEs [38] . However, these models typically assume that the data follows an underlying SDE structure, as in financial time series [82, 33] , which limits their general applicability. On the other hand, representing finite-dimensional data as continuous functions offers several advantages: it naturally supports variable resolution, accommodates diverse data modalities using simple architectures, and enhances memory efficiency [16] . Motivated by these benefits, recent works have extended generative modeling beyond finite-dimensional Euclidean spaces to functional settings. Dutordoir et al. [17] and Zhuang et al. [85] adapt existing diffusion models to functional data by conditioning on discretized pointwise evaluations. A more general direction involves defining stochastic processes directly in infinite-dimensional Hilbert spaces, leading to the development of functional diffusion models [36, 20, 5, 60, 48, 49, 65, 27, 62] . These works extend score-based methods by studying diffusion processes over function spaces. Similarly, functional flow matching [37] generalizes the flow matching framework of Lipman et al. [50] to infinite-dimensional settings. However, as noted in their work, the analysis of [37] relies on strong measure-theoretic assumptions that are often difficult to verify in practice. In contrast, we extend rectified flow to Hilbert spaces under more tractable and verifiable conditions, providing a rigorous and broadly applicable foundation for functional generative modeling. Rectified flows on Hilbert space In this section, we extend rectified flows to infinite-dimensional Hilbert spaces, demonstrating the fundamental property of marginal distribution preservation. Let H be a separable Hilbert space. Given a probability triplet (Ω, S
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Spectral Convolutional Conditional Neural ProcessesPeiman Mohseni, Nick DuffieldNeurIPS 2025 · 被引用 10 次
- Relative Entropy Estimation in Function Space: Theory and Applications to Trajectory InferenceCHAO WANG, Luca Nepote, Giulio Franzese, Pietro MichiardiICML 2026
它引用的顶会 Paper34
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li 等NeurIPS 2022 · 被引用 8,965 次
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell 等NeurIPS 2020 · 被引用 4,008 次
- Diffusion Probabilistic FieldsPeiye Zhuang, Samira Abnar, Jiatao Gu, Alexander G. Schwing 等ICLR 2023 · 被引用 3,587 次
相关 Paper
- Functional Mean Flow in Hilbert SpaceZhiqi Li, Yuchen Sun, Greg Turk, Bo ZhuCVPR 2026 · 被引用 5 次
- On the Relation between Rectified Flows and Optimal TransportJohannes Hertrich, Antonin Chambolle, Julie DelonNeurIPS 2025 · 被引用 15 次
- Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified FlowXingchao Liu, Chengyue Gong, Qiang LiuICLR 2023 · 被引用 75 次
- Rectified Diffusion: Straightness Is Not Your Need in Rectified FlowFu-Yun Wang, Ling Yang, Zhaoyang Huang, Mengdi Wang 等ICLR 2025
- Towards Hierarchical Rectified FlowYichi Zhang, Yici Yan, Alexander G. Schwing, Zhizhen ZhaoICLR 2025
