Smoothed Online Learning for Prediction in Piecewise Affine Systems
Adam Block, Max Simchowitz, Russ Tedrake
Abstract
The problem of piecewise affine (PWA) regression and planning is of foundational importance to the study of online learning, control, and robotics, where it provides a theoretically and empirically tractable setting to study systems undergoing sharp changes in the dynamics. Unfortunately, due to the discontinuities that arise when crossing into different ``pieces,'' learning in general sequential settings is impossible and practical algorithms are forced to resort to heuristic approaches. This paper builds on the recently developed smoothed online learning framework and provides the first algorithms for prediction and simulation in PWA systems whose regret is polynomial in all relevant problem parameters under a weak smoothness assumption; moreover, our algorithms are efficient in the number of calls to an optimization oracle. We further apply our results to the problems of one-step prediction and multi-step simulation regret in piecewise affine dynamical systems, where the learner is tasked with simulating trajectories and regret is measured in terms of the Wasserstein distance between simulated and true data. Along the way, we develop several technical tools of more general interest.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3ec18951-c19c-49bf-a6e1-26e5be0ddd2dCited by top-tier papers4
- Transformers as Algorithms: Generalization and Stability in In-context LearningYingcong Li, Muhammed Emrullah Ildiz, Dimitris Papailiopoulos, Samet OymakICML 2023 · 242 citations
- From Self-Attention to Markov Models: Unveiling the Dynamics of Generative TransformersMuhammed Emrullah Ildiz, Yixiao Huang, Yingcong Li, Ankit Singh Rawat et al.ICML 2024 · 45 citations
- Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and AutoregressionAdam Block, Dylan J. Foster, Akshay Krishnamurthy, Max Simchowitz et al.ICLR 2024 · 12 citations
- Oracle-Efficient Differentially Private Learning with Public DataAdam Block, Mark Bun, Rathin Desai, Abhishek Shetty et al.NeurIPS 2024 · 6 citations
Builds on6
- Naive Exploration is Optimal for Online LQRMax Simchowitz, Dylan J. FosterICML 2020 · 209 citations
- Do Differentiable Simulators Give Better Policy Gradients?Hyung Ju Terry Suh, Max Simchowitz, Kaiqing Zhang, Russ TedrakeICML 2022 · 129 citations
- Smoothed Analysis of Online and Differentially Private LearningNika Haghtalab, Tim Roughgarden, Abhishek ShettyNeurIPS 2020 · 66 citations
- Efficient and Near-Optimal Smoothed Online Learning for Generalized Linear FunctionsAdam Block, Max SimchowitzNeurIPS 2022 · 14 citations
- Smoothed Analysis with Adaptive AdversariesNika Haghtalab, Tim Roughgarden, Abhishek ShettyFOCS 2021 · 4 citations
Related papers
- Smoothed Online Combinatorial Optimization Using Imperfect PredictionsKai Wang, Zhao Song, Georgios Theocharous, Sridhar MahadevanAAAI 2023 · 1 citation
- Revisiting Smoothed Online LearningLijun Zhang, Wei Jiang, Shiyin Lu, Tianbao YangNeurIPS 2021 · 41 citations
- Adaptive Online Estimation of Piecewise Polynomial TrendsDheeraj Baby, Yu-Xiang WangNeurIPS 2020 · 13 citations
- Online learning in MDPs with linear function approximation and bandit feedbackGergely Neu, Julia OlkhovskayaNeurIPS 2021 · 41 citations
- Minimax Adaptive Online Nonparametric Regression over Besov spacesPaul Liautaud, Pierre Gaillard, Olivier WintenbergerNeurIPS 2025 · 2 citations
