Power-aware pruning for ultrafast, energy-efficient, and accurate optical neural network design
Naoki Hattori, Yutaka Masuda, Tohru Ishihara, Akihiko Shinya, Masaya Notomi
Abstract
With the rapid progress of the integrated nanophotonics technology, the optical neural network (ONN) architecture has been widely investigated. Although the ONN inference is fast, conventional densely connected network structures consume large amounts of power in laser sources. We propose a novel ONN design method that finds an ultrafast, energy-efficient, and accurate ONN structure. The key idea is power-aware edge pruning that derives the near-optimal numbers of edges in the entire network. Optoelectronic circuit simulation demonstrates the correct functional behavior of the ONN. Furthermore, experimental evaluations using tensor-flow show the proposed methods achieved 98.28% power reduction without significant loss of accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7797229d-0ba6-4e33-a391-c1dae4852208Related papers
- Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order OptimizationJiaqi Gu, Chenghao Feng, Zheng Zhao, Zhoufeng Ying et al.AAAI 2021 · 41 citations
- FLOPS: EFficient On-Chip Learning for OPtical Neural Networks Through Stochastic Zeroth-Order OptimizationJiaqi Gu, Zheng Zhao, Chenghao Feng, Wuxi Li et al.DAC 2020 · 20 citations
- Binary Optical Machine Learning: Million-Scale Physical Neural Networks with Nano NeuronsXueyuan Yang, Zhenlin An, Qingrui Pan, Lei Yang et al.MobiCom 2024 · 3 citations
- PowerPruning: Selecting Weights and Activations for Power-Efficient Neural Network AccelerationRichard Petri, Grace Li Zhang, Yiran Chen, Ulf Schlichtmann et al.DAC 2023 · 11 citations
- ADEPT: automatic differentiable DEsign of photonic tensor coresJiaqi Gu, Hanqing Zhu, Chenghao Feng, Zixuan Jiang et al.DAC 2022 · 18 citations
