PIXEL: Photonic Neural Network Accelerator
Kyle Shiflett, Dylan Wright, Avinash Karanth, Ahmed Louri
摘要
Machine learning (ML) architectures such as Deep Neural Networks (DNNs) have achieved unprecedented accuracy on modern applications such as image classification and speech recognition. With power dissipation becoming a major concern in ML architectures, computer architects have focused on designing both energy-efficient hardware platforms as well as optimizing ML algorithms. To dramatically reduce power consumption and increase parallelism in neural network accelerators, disruptive technology such as silicon photonics has been proposed which can improve the performance-per-Watt when compared to electrical implementation. In this paper, we propose PIXEL - Photonic Neural Network Accelerator that efficiently implements the fundamental operation in neural computation, namely the multiply and accumulate (MAC) functionality using photonic components such as microring resonators (MRRs) and Mach-Zehnder interferometer (MZI). We design two versions of PIXEL - a hybrid version that multiplies optically and accumulates electrically and a fully optical version that multiplies and accumulates optically. We perform a detailed power, area and timing analysis of the different versions of photonic and electronic accelerators for different convolution neural networks (AlexNet, VGG16, and others). Our results indicate a significant improvement in the energy-delay product for both PIXEL designs over traditional electrical designs (48.4% for OE and 73.9% for OO) while minimizing latency, at the cost of increased area over electrical designs.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper11
- SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head PruningHanrui Wang, Zhekai Zhang, Song HanHPCA 2021 · 被引用 412 次
- CrossLight: A Cross-Layer Optimized Silicon Photonic Neural Network AcceleratorFebin Sunny, Asif Mirza, Mahdi Nikdast, Sudeep PasrichaDAC 2021 · 被引用 92 次
- SuperNPU: An Extremely Fast Neural Processing Unit Using Superconducting Logic DevicesKoki Ishida, Ilkwon Byun, Ikki Nagaoka, Kosuke Fukumitsu 等MICRO 2020 · 被引用 66 次
- Albireo: Energy-Efficient Acceleration of Convolutional Neural Networks via Silicon PhotonicsKyle Shiflett, Avinash Karanth, Razvan C. Bunescu, Ahmed LouriISCA 2021 · 被引用 44 次
- NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device SimulationJiaqi Gu, Zhengqi Gao, Chenghao Feng, Hanqing Zhu 等NeurIPS 2022 · 被引用 39 次
相关 Paper
- Lightening-Transformer: A Dynamically-Operated Optically-Interconnected Photonic Transformer AcceleratorHanqing Zhu, Jiaqi Gu, Hanrui Wang, Zixuan Jiang 等HPCA 2024 · 被引用 44 次
- Mirage: An RNS-Based Photonic Accelerator for DNN TrainingCansu Demirkiran, Guowei Yang, Darius Bunandar, Ajay JoshiISCA 2024 · 被引用 16 次
- Towards Memory-Efficient Neural Networks via Multi-Level in situ GenerationJiaqi Gu, Hanqing Zhu, Chenghao Feng, Mingjie Liu 等ICCV 2021 · 被引用 4 次
- PhotoFourier: A Photonic Joint Transform Correlator-Based Neural Network AcceleratorShurui Li, Hangbo Yang, Chee Wei Wong, Volker J. Sorger 等HPCA 2023 · 被引用 18 次
- Scaling Deep-Learning Inference with Chiplet-based Architecture and Photonic InterconnectsYuan Li, Ahmed Louri, Avinash KaranthDAC 2021 · 被引用 21 次
