Fault Diagnosis of Irregular Sequences by Adjoint Learning in Continuous-Time Model Space
Xiren Zhou, Chuyang Wei, Ao Chen, Shikang Liu, Xiangyu Wang, Huanhuan Chen
Abstract
Fault Diagnosis (FD) on sequential data suffers from irregular sampling (with missing values), limited training data, and varying underlying environments. In response, this paper proposes FD by adjoint learning in continuous-time model space. Model-Space Learning employs well-fitted models that capture data's dynamics (i.e., changing information) as more stable and concise representations of the original data. The Continuous-Time Reservoir Computing Network (CT-Res) is first introduced, which embeds Ordinary Differential Equation (ODE) within the reservoir-based hidden layer to govern continuous-time hidden-state evolution, naturally handling irregular sampling without relying on fixed time steps and effectively capturing intrinsic data dynamics. By fitting each sequence via CT-Res and representing it with the fitted model, the original sequences are mapped from the data space into the continuous-time model space. We further develop an adjoint learning strategy by incorporating a discrete-time "adjoint Echo State Network (ESN)" that shares structure and parameters with CT-Res, thus enabling efficient training by bypassing the computationally intensive ODE solver, with joint optimization of fitting accuracy and class discrimination in the model space. Experiments on multiple FD benchmarks highlight the effectiveness and efficiency of our study, particularly with missing values and scarce training data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b58a6ae6-ca01-468b-816a-0cfaf0bbf4bcBuilds on6
- Neural Controlled Differential Equations for Irregular Time SeriesPatrick Kidger, James Morrill, James Foster, Terry J. LyonsNeurIPS 2020 · 850 citations
- Multi-Time Attention Networks for Irregularly Sampled Time SeriesSatya Narayan Shukla, Benjamin M. MarlinICLR 2021 · 301 citations
- PrimeNet: Pre-training for Irregular Multivariate Time SeriesRanak Roy Chowdhury, Jiacheng Li, Xiyuan Zhang, Dezhi Hong et al.AAAI 2023 · 37 citations
- Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time SeriesJiawen Zhang, Shun Zheng, Wei Cao, Jiang Bian et al.KDD 2023 · 36 citations
- ODE-RSSM: Learning Stochastic Recurrent State Space Model from Irregularly Sampled DataZhaolin Yuan, Xiaojuan Ban, Zixuan Zhang, Xiaorui Li et al.AAAI 2023 · 8 citations
Related papers
- Efficient Anomaly Detection of Irregular Sequences in Ct-Echo Model SpaceAo Chen, Xiren Zhou, Huanhuan ChenAAAI 2025 · 2 citations
- Learning continuous-time PDEs from sparse data with graph neural networksValerii Iakovlev, Markus Heinonen, Harri LähdesmäkiICLR 2021 · 81 citations
- Do Residual Neural Networks discretize Neural Ordinary Differential Equations?Michael E. Sander, Pierre Ablin, Gabriel PeyréNeurIPS 2022 · 42 citations
- ParalESN: Enabling parallel information processing in Reservoir ComputingMatteo Pinna, Giacomo Lagomarsini, Andrea Ceni, Claudio GallicchioICML 2026
- Symplectic Adjoint Method for Exact Gradient of Neural ODE with Minimal MemoryTakashi Matsubara, Yuto Miyatake, Takaharu YaguchiNeurIPS 2021 · 30 citations
