Power-aware pruning for ultrafast, energy-efficient, and accurate optical neural network design
Naoki Hattori, Yutaka Masuda, Tohru Ishihara, Akihiko Shinya, Masaya Notomi
摘要
With the rapid progress of the integrated nanophotonics technology, the optical neural network (ONN) architecture has been widely investigated. Although the ONN inference is fast, conventional densely connected network structures consume large amounts of power in laser sources. We propose a novel ONN design method that finds an ultrafast, energy-efficient, and accurate ONN structure. The key idea is power-aware edge pruning that derives the near-optimal numbers of edges in the entire network. Optoelectronic circuit simulation demonstrates the correct functional behavior of the ONN. Furthermore, experimental evaluations using tensor-flow show the proposed methods achieved 98.28% power reduction without significant loss of accuracy.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
相关 Paper
- Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order OptimizationJiaqi Gu, Chenghao Feng, Zheng Zhao, Zhoufeng Ying 等AAAI 2021 · 被引用 41 次
- FLOPS: EFficient On-Chip Learning for OPtical Neural Networks Through Stochastic Zeroth-Order OptimizationJiaqi Gu, Zheng Zhao, Chenghao Feng, Wuxi Li 等DAC 2020 · 被引用 20 次
- Binary Optical Machine Learning: Million-Scale Physical Neural Networks with Nano NeuronsXueyuan Yang, Zhenlin An, Qingrui Pan, Lei Yang 等MobiCom 2024 · 被引用 3 次
- PowerPruning: Selecting Weights and Activations for Power-Efficient Neural Network AccelerationRichard Petri, Grace Li Zhang, Yiran Chen, Ulf Schlichtmann 等DAC 2023 · 被引用 11 次
- ADEPT: automatic differentiable DEsign of photonic tensor coresJiaqi Gu, Hanqing Zhu, Chenghao Feng, Zixuan Jiang 等DAC 2022 · 被引用 18 次
