P-DAC: Power-Efficient Photonic Accelerators for LLM Inference
Wen-Tse Chang, Chun-Feng Wu, Yun-Chen Lo
Abstract
As traditional electronic hardware encounters the limitations of Moore's Law, optical computing is emerging as a promising alternative, delivering high data transmission rates, especially beneficial for big data and AI applications. Photonic accelerators, such as the Lightening-Transformer, utilize optical analog signals to accelerate Transformerbased models, achieving exceptional speed and low energy consumption. However, controlling modern optical intensity modulators (e.g., Mach-Zehnder Modulators) requires using electrical analog signals (e.g., voltage values) to adjust the optical signal intensity for realizing optical-based vector inner product calculations. Managing this modulation consumes significant power, as it involves selecting optimal electrical values through an electrical controller and converting digital signals to analog using digital-to-analog converters (DACs). In this work, we introduce P-DAC, a solution designed to reduce DAC power consumption, significantly enhancing the energy efficiency of optical accelerators for Transformer models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a334c140-e1c1-4f15-aabc-ff5495ce83f5Builds on10
- Training data-efficient image transformers & distillation through attentionHugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa et al.ICML 2021 · 8,974 citations
- Efficient Memory Management for Large Language Model Serving with PagedAttentionWoosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng et al.SOSP 2023 · 1,016 citations
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache ManagementWonbeom Lee, Jungi Lee, Junghwan Seo, Jaewoong SimOSDI 2024 · 248 citations
- S3: Increasing GPU Utilization during Generative Inference for Higher ThroughputYunho Jin, Chun-Feng Wu, David Brooks, Gu-Yeon WeiNeurIPS 2023 · 150 citations
- Lightening-Transformer: A Dynamically-Operated Optically-Interconnected Photonic Transformer AcceleratorHanqing Zhu, Jiaqi Gu, Hanrui Wang, Zixuan Jiang et al.HPCA 2024 · 44 citations
Related papers
- PIXEL: Photonic Neural Network AcceleratorKyle Shiflett, Dylan Wright, Avinash Karanth, Ahmed LouriHPCA 2020 · 56 citations
- Mokey: enabling narrow fixed-point inference for out-of-the-box floating-point transformer modelsAli Hadi Zadeh, Mostafa Mahmoud, Ameer Abdelhadi, Andreas MoshovosISCA 2022 · 36 citations
- Lightator: An Optical Near-Sensor Accelerator with Compressive Acquisition Enabling Versatile Image ProcessingMehrdad Morsali, Brendan Reidy, Deniz Najafi, Sepehr Tabrizchi et al.DAC 2024 · 15 citations
- Albireo: Energy-Efficient Acceleration of Convolutional Neural Networks via Silicon PhotonicsKyle Shiflett, Avinash Karanth, Razvan C. Bunescu, Ahmed LouriISCA 2021 · 44 citations
- Lightning: A Reconfigurable Photonic-Electronic SmartNIC for Fast and Energy-Efficient InferenceZhizhen Zhong, Mingran Yang, Jay Lang, Christian Williams et al.SIGCOMM 2023 · 25 citations
