Random Controlled Differential Equations
Francesco Piatti, Thomas Cass, William F. Turner
摘要
We introduce a training-efficient framework for time-series learning that combines random features with controlled differential equations (CDEs). In this approach, large randomly parameterized CDEs act as continuous-time reservoirs, mapping input paths to rich representations. Only a linear readout layer is trained, resulting in fast, scalable models with strong inductive bias. Building on this foundation, we propose two variants: (i) Random Fourier CDEs (RF-CDEs): these lift the input signal using random Fourier features prior to the dynamics, providing a kernel-free approximation of RBF-enhanced sequence models; (ii) Random Rough DEs (R-RDEs): these operate directly on rough-path inputs via a log-ODE discretisation, using log-signatures to capture higher-order temporal interactions while remaining stable and efficient. We prove that in the infinite-width limit, these model induces the RBF-lifted signature kernel and the rough signature kernel, respectively, offering a unified perspective on random-feature reservoirs, continuous-time deep architectures, and path-signature theory. We evaluate both models across a range of time-series benchmarks, demonstrating competitive or state-of-the-art performance. These methods provide a practical alternative to explicit signature computations, retaining their inductive bias while benefiting from the efficiency of random features. Code is publicly available at: https://github.com/ FrancescoPiatti/RandomSigJax
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 被引用 850 次
- Neural Rough Differential Equations for Long Time SeriesJames Morrill, Cristopher Salvi, Patrick Kidger, James FosterICML 2021 · 被引用 176 次
- Higher Order Kernel Mean Embeddings to Capture Filtrations of Stochastic ProcessesCristopher Salvi, Maud Lemercier, Chong Liu, Blanka Horvath 等NeurIPS 2021 · 被引用 43 次
- Bayesian Learning from Sequential Data using Gaussian Processes with Signature CovariancesCsaba Tóth, Harald OberhauserICML 2020 · 被引用 40 次
- Neural signature kernels as infinite-width-depth-limits of controlled ResNetsNicola Muca Cirone, Maud Lemercier, Cristopher SalviICML 2023 · 被引用 33 次
相关 Paper
- Log Neural Controlled Differential Equations: The Lie Brackets Make A DifferenceBenjamin Walker, Andrew D. McLeod, Tiexin Qin, Yichuan Cheng 等ICML 2024 · 被引用 27 次
- LORD: Lower-Dimensional Embedding of Log-Signature in Neural Rough Differential EquationsJaehoon Lee, Jinsung Jeon, Sheo Yon Jhin, Jihyeon Hyeong 等ICLR 2022 · 被引用 2 次
- A Temporal Kernel Approach for Deep Learning with Continuous-time InformationDa Xu, Chuanwei Ruan, Evren Körpeoglu, Sushant Kumar 等ICLR 2021 · 被引用 7 次
- Non-adversarial training of Neural SDEs with signature kernel scoresZacharia Issa, Blanka Horvath, Maud Lemercier, Cristopher SalviNeurIPS 2023 · 被引用 56 次
- Exact Gradients for Stochastic Spiking Neural Networks Driven by Rough SignalsChristian Holberg, Cristopher SalviNeurIPS 2024 · 被引用 14 次
