Accelerating Eigenvalue Dataset Generation via Chebyshev Subspace Filter
Hong Wang, Jie Wang, Jian Luo, Huanshuo Dong, Yeqiu Chen, Runmin Jiang, Zhen Huang
Abstract
Eigenvalue problems are among the most important topics in many scientific disciplines. With the recent surge and development of machine learning, neural eigenvalue methods have attracted significant attention as a forward pass of inference requires only a tiny fraction of the computation time compared to traditional solvers. However, a key limitation is the requirement for large amounts of labeled data in training, including operators and their eigenvalues. To tackle this limitation, we propose a novel method, named Sorting Chebyshev Subspace Filter (SCSF), which significantly accelerates eigenvalue data generation by leveraging similarities between operators---a factor overlooked by existing methods. Specifically, SCSF employs truncated fast Fourier transform (FFT) sorting to group operators with similar eigenvalue distributions and constructs a Chebyshev subspace filter that leverages eigenpairs from previously solved problems to assist in solving subsequent ones, reducing redundant computations. To the best of our knowledge, SCSF is the first method to accelerate eigenvalue data generation. Experimental results show that SCSF achieves up to a speedup compared to various numerical solvers.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on15
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- NeuralEF: Deconstructing Kernels by Deep Neural NetworksZhijie Deng, Jiaxin Shi, Jun ZhuICML 2022 · 29 citations
- Neural Krylov Iteration for Accelerating Linear System SolvingJian Luo, Jie Wang, Hong Wang, Huanshuo Dong et al.NeurIPS 2024 · 23 citations
- Clifford Neural Layers for PDE ModelingJohannes Brandstetter, Rianne van den Berg, Max Welling, Jayesh K. GuptaICLR 2023 · 21 citations
- Mixture-of-Experts Operator Transformer for Large-Scale PDE Pre-TrainingHong Wang, Haiyang Xin, Jie Wang, Xuanze Yang et al.NeurIPS 2025 · 15 citations
Related papers
- Accelerating Data Generation for Neural Operators via Krylov Subspace RecyclingHong Wang, Zhongkai Hao, Jie Wang, Zijie Geng et al.ICLR 2024 · 14 citations
- Operator SVD with Neural Networks via Nested Low-Rank ApproximationJongha Jon Ryu, Xiangxiang Xu, Hasan Sabri Melihcan Erol, Yuheng Bu et al.ICML 2024 · 10 citations
- Accelerating PDE Data Generation via Differential Operator Action in Solution SpaceHuanshuo Dong, Hong Wang, Haoyang Liu, Jian Luo et al.ICML 2024 · 14 citations
- Amortized Eigendecomposition for Neural NetworksTianbo Li, Zekun Shi, Jiaxi Zhao, Min LinNeurIPS 2024 · 4 citations
- Fast Training of Large Kernel Models with Delayed ProjectionsAmirhesam Abedsoltan, Siyuan Ma, Parthe Pandit, Misha BelkinNeurIPS 2025 · 2 citations
