Random Controlled Differential Equations
Francesco Piatti, Thomas Cass, William F. Turner
Abstract
We introduce a training-efficient framework for time-series learning that combines random features with controlled differential equations (CDEs). In this approach, large randomly parameterized CDEs act as continuous-time reservoirs, mapping input paths to rich representations. Only a linear readout layer is trained, resulting in fast, scalable models with strong inductive bias. Building on this foundation, we propose two variants: (i) Random Fourier CDEs (RF-CDEs): these lift the input signal using random Fourier features prior to the dynamics, providing a kernel-free approximation of RBF-enhanced sequence models; (ii) Random Rough DEs (R-RDEs): these operate directly on rough-path inputs via a log-ODE discretisation, using log-signatures to capture higher-order temporal interactions while remaining stable and efficient. We prove that in the infinite-width limit, these model induces the RBF-lifted signature kernel and the rough signature kernel, respectively, offering a unified perspective on random-feature reservoirs, continuous-time deep architectures, and path-signature theory. We evaluate both models across a range of time-series benchmarks, demonstrating competitive or state-of-the-art performance. These methods provide a practical alternative to explicit signature computations, retaining their inductive bias while benefiting from the efficiency of random features. Code is publicly available at: https://github.com/ FrancescoPiatti/RandomSigJax
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4514a030-cb3d-4e2b-95d7-7f6b892fdf21Builds on6
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 citations
- Neural Rough Differential Equations for Long Time SeriesJames Morrill, Cristopher Salvi, Patrick Kidger, James FosterICML 2021 · 176 citations
- Higher Order Kernel Mean Embeddings to Capture Filtrations of Stochastic ProcessesCristopher Salvi, Maud Lemercier, Chong Liu, Blanka Horvath et al.NeurIPS 2021 · 43 citations
- Bayesian Learning from Sequential Data using Gaussian Processes with Signature CovariancesCsaba Tóth, Harald OberhauserICML 2020 · 40 citations
- Neural signature kernels as infinite-width-depth-limits of controlled ResNetsNicola Muca Cirone, Maud Lemercier, Cristopher SalviICML 2023 · 33 citations
Related papers
- Log Neural Controlled Differential Equations: The Lie Brackets Make A DifferenceBenjamin Walker, Andrew D. McLeod, Tiexin Qin, Yichuan Cheng et al.ICML 2024 · 27 citations
- LORD: Lower-Dimensional Embedding of Log-Signature in Neural Rough Differential EquationsJaehoon Lee, Jinsung Jeon, Sheo Yon Jhin, Jihyeon Hyeong et al.ICLR 2022 · 2 citations
- A Temporal Kernel Approach for Deep Learning with Continuous-time InformationDa Xu, Chuanwei Ruan, Evren Körpeoglu, Sushant Kumar et al.ICLR 2021 · 7 citations
- Non-adversarial training of Neural SDEs with signature kernel scoresZacharia Issa, Blanka Horvath, Maud Lemercier, Cristopher SalviNeurIPS 2023 · 56 citations
- Exact Gradients for Stochastic Spiking Neural Networks Driven by Rough SignalsChristian Holberg, Cristopher SalviNeurIPS 2024 · 14 citations
