MemSens: Significantly Reducing Memory Overhead in Adjoint Sensitivity Analysis Using Novel Error-Bounded Lossy Compression
Chenxi Li, Yihang Feng, Fuxing Deng, Dingwen Tao, Weifeng Liu, Zhou Jin
Abstract
Adjoint sensitivity analysis is an exceptionally efficient method for computing the gradient of an objective function with respect to given parameters, playing a crucial role in modern circuit design and verification. According to the principles of the adjoint method, it is necessary to store all essential system state information, such as state vectors and Jacobian matrices, at each time step during the forward integration process in order to construct the adjoint equations during the backward integration. Therefore, the memory overhead of the adjoint method is proportional to the system size and the number of time steps, resulting in prohibitive memory costs for solving large-scale dynamic systems.In this paper, we propose a novel, memory-efficient adjoint sensitivity analysis method that significantly reduces the memory overhead of storing system state information by employing error-bounded lossy compression techniques. Our compression algorithm effectively utilizes the spatiotemporal characteristics of data in circuit simulations and incorporates stringent error control mechanisms. This approach achieves a two-order-ofmagnitude reduction in memory overhead during simulation while ensuring that the accuracy of the adjoint solution remains unaffected.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 944d9eb1-bd05-4d4e-9447-40e5f25f2033Related papers
- MASC: A Memory-Efficient Adjoint Sensitivity Analysis through Compression Using Novel Spatiotemporal PredictionChenxi Li, Boyuan Zhang, Yongqiang Duan, Yang Li et al.DAC 2024 · 4 citations
- Adjoint Transient Sensitivity Analysis for Objective Functions Associated to Many Time PointsWenfei Hu, Zuochang Ye, Yan WangDAC 2020 · 8 citations
- PiSPICE: Accelerating Post-Layout SPICE Simulation via Essential Parasitic IdentificationZhou Jin, Jing Li, Jian Xin, Tianjia Zhou et al.DAC 2025
- Symplectic Adjoint Method for Exact Gradient of Neural ODE with Minimal MemoryTakashi Matsubara, Yuto Miyatake, Takaharu YaguchiNeurIPS 2021 · 30 citations
- Automatic quantization for physics-based simulationJiafeng Liu, Haoyang Shi, Siyuan Zhang, Yin Yang et al.SIGGRAPH 2022
