Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantification
Ruoxi Jiang, Rebecca Willett
Abstract
This paper explores learning emulators for parameter estimation with uncertainty estimation of high-dimensional dynamical systems. We assume access to a computationally complex simulator that inputs a candidate parameter and outputs a corresponding multichannel time series. Our task is to accurately estimate a range of likely values of the underlying parameters. Standard iterative approaches necessitate running the simulator many times, which is computationally prohibitive. This paper describes a novel framework for learning feature embeddings of observed dynamics jointly with an emulator that can replace high-cost simulators for parameter estimation. Leveraging a contrastive learning approach, our method exploits intrinsic data properties within and across parameter and trajectory domains. On a coupled 396-dimensional multiscale Lorenz 96 system, our method significantly outperforms a typical parameter estimation method based on predefined metrics and a classical numerical simulator, and with only 1.19% of the baseline's computation time. Ablation studies highlight the potential of explicitly designing learned emulators for parameter estimation by leveraging contrastive learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d7942421-2f96-4fad-bed8-c2050697ec06Cited by top-tier papers3
- Training neural operators to preserve invariant measures of chaotic attractorsRuoxi Jiang, Peter Y. Lu, Elena Orlova, Rebecca WillettNeurIPS 2023 · 59 citations
- CARE: Modeling Interacting Dynamics Under Temporal Environmental VariationXiao Luo, Haixin Wang, Zijie Huang, Huiyu Jiang et al.NeurIPS 2023 · 13 citations
- Deep Stochastic MechanicsElena Orlova, Aleksei Ustimenko, Ruoxi Jiang, Peter Y. Lu et al.ICML 2024 · 2 citations
Builds on14
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
Related papers
- On Contrastive Representations of Stochastic ProcessesEmile Mathieu, Adam Foster, Yee Whye TehNeurIPS 2021 · 15 citations
- On Contrastive Learning for Likelihood-free InferenceConor Durkan, Iain Murray, George PapamakariosICML 2020 · 149 citations
- Contrastive Trajectory Similarity Learning with Dual-Feature AttentionYanchuan Chang, Jianzhong Qi, Yuxuan Liang, Egemen TaninICDE 2023 · 77 citations
- Provable Representation Learning for Imitation with Contrastive Fourier FeaturesOfir Nachum, Mengjiao YangNeurIPS 2021 · 41 citations
- Learning to Emulate Chaos: Adversarial Optimal Transport RegularizationGabriel Melo, Leonardo Santiago, Peter Y. LuICML 2026 · 1 citation
