mLR: Scalable Laminography Reconstruction based on Memoization
Bin Ma, Viktor Nikitin, Xi Wang, Tekin Bicer, Dong Li
摘要
ADMM-FFT is an iterative method with high reconstruction accuracy for laminography but suffers from excessive computation time and large memory consumption. We introduce mLR, which employs memoization to replace the time-consuming Fast Fourier Transform (FFT) operations based on an unique observation that similar FFT operations appear in iterations of ADMM-FFT. We introduce a series of techniques to make the application of memoization to ADMM-FFT performance-beneficial and scalable. We also introduce variable offloading to save CPU memory and scale ADMM-FFT across GPUs within and across nodes. Using mLR, we are able to scale ADMM-FFT on an input problem of 2K × 2K × 2K, which is the largest input problem laminography reconstruction has ever worked on with the ADMM-FFT solution on limited memory; mLR brings 52.8% performance improvement on average (up to 65.4%), compared to the original ADMM-FFT.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- ZeRO-Offload: Democratizing Billion-Scale Model TrainingJie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, Olatunji Ruwase 等USENIX ATC 2021 · 被引用 657 次
- HM-ANN: Efficient Billion-Point Nearest Neighbor Search on Heterogeneous MemoryJie Ren, Minjia Zhang, Dong LiNeurIPS 2020 · 被引用 136 次
- InfiniCache: Exploiting Ephemeral Serverless Functions to Build a Cost-Effective Memory CacheAo Wang, Jingyuan Zhang, Xiaolong Ma, Ali Anwar 等FAST 2020 · 被引用 118 次
- Sentinel: Efficient Tensor Migration and Allocation on Heterogeneous Memory Systems for Deep LearningJie Ren, Jiaolin Luo, Kai Wu, Minjia Zhang 等HPCA 2021 · 被引用 62 次
相关 Paper
- MLP-Offload: Multi-Level, Multi-Path Offloading for LLM Pre-training to Break the GPU Memory WallAvinash Maurya, M. Mustafa Rafique, Franck Cappello, Bogdan NicolaeSC 2025 · 被引用 2 次
- A Scalable Distributed Framework for Multimodal GigaVoxel Image RegistrationRohit Jena, Vedant Zope, Pratik Chaudhari, James GeeICLR 2026
- 3DGS-LM: Faster Gaussian-Splatting Optimization with Levenberg-MarquardtLukas Höllein, Aljaz Bozic, Michael Zollhöfer, Matthias NießnerICCV 2025 · 被引用 10 次
- Efficient Unrolled Networks for Large-Scale 3D Inverse ProblemsRomain Vo, Julián TachellaCVPR 2026 · 被引用 3 次
- Efficient Combination of Rematerialization and Offloading for Training DNNsOlivier Beaumont, Lionel Eyraud-Dubois, Alena ShilovaNeurIPS 2021 · 被引用 69 次
