Self-Attention to Operator Learning-based 3D-IC Thermal Simulation
Zhen Huang, Hong Wang, Wenkai Yang, Muxi Tang, Depeng Xie, Ting-Jung Lin, Yu Zhang, Wei W. Xing, Lei He
Abstract
Thermal management in 3D ICs is increasingly challenging due to higher power densities. Traditional PDESolving based methods, while accurate, are too slow for iterative design. Machine learning approaches like FNO provide faster alternatives but suffer from high-frequency information loss and high-fidelity data dependency. We introduce Self-Attention UNet Fourier Neural Operator (SAU-FNO), a novel framework combining self-attention and U-Net with FNO to capture longrange dependencies and model local high-frequency features effectively. Transfer learning is employed to fine-tune low-fidelity data, minimizing the need for extensive high-fidelity datasets and speeding up training. Experiments demonstrate that SAUFNO achieves state-of-the-art thermal prediction accuracy and provides an speedup over traditional FEM methods, making it an efficient tool for advanced 3D IC thermal simulations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eab2cb08-0497-4b51-a22e-2c4c3ee6dd52Cited by top-tier papers4
- HGATSolver: A Heterogeneous Graph Attention Solver for Fluid-Structure InteractionQin-Yi Zhang, Hong Wang, Siyao Liu, Haichuan Lin et al.AAAI 2026 · 1 citation
- Learning Neural Operators from Partial Observations via Latent Autoregressive ModelingJingren Hou, Hong Wang, Pengyu Xu, Chang Gao et al.AAAI 2026 · 1 citation
- Accelerating Eigenvalue Dataset Generation via Chebyshev Subspace FilterHong Wang, Jie Wang, Jian Luo, Huanshuo Dong et al.ICLR 2026 · 1 citation
- Learning-Guided Integration Contours Construction for Fast Large-Scale Generalized EigensolversYeqiu Chen, Ziyan Liu, Hong Wang, Lei LiuICML 2026 · 1 citation
Builds on3
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- DeepOHeat: Operator Learning-based Ultra-fast Thermal Simulation in 3D-IC DesignZiyue Liu, Yixing Li, Jing Hu, Xinling Yu et al.DAC 2023 · 50 citations
- GAR: Generalized Autoregression for Multi-Fidelity FusionYuxin Wang, Zheng Xing, Wei W. XingNeurIPS 2022 · 6 citations
Related papers
- Component Fourier Neural Operator for Singularly Perturbed Differential EquationsYe Li, Ting Du, Yiwen Pang, Zhongyi HuangAAAI 2024 · 6 citations
- NeuralMesh: Neural Network For FEM Mesh Generation in 2.5D/3D Chiplet Thermal SimulationPengju Chen, Dan Niu, Dekang Zhang, Wenhao Wang et al.DAC 2025 · 3 citations
- Maximal Update Parametrization and Zero-Shot Hyperparameter Transfer for Fourier Neural OperatorsShanda Li, Shinjae Yoo, Yiming YangICML 2025
- Factorized Fourier Neural OperatorsAlasdair Tran, Alexander Patrick Mathews, Lexing Xie, Cheng Soon OngICLR 2023 · 56 citations
- SAOT: An Enhanced Locality-Aware Spectral Transformer for Solving PDEsChenhong Zhou, Jie Chen, Zaifeng YangAAAI 2026 · 3 citations
