Extending Power of Nature from Binary to Real-Valued Graph Learning in Real World
Chunshu Wu, Ruibing Song, Chuan Liu, Yunan Yang, Ang Li, Michael C. Huang, Tong Geng
摘要
Nature performs complex computations constantly at clearly lower cost and higher performance than digital computers. It is crucial to understand how to harness the unique computational power of nature in Machine Learning (ML). In the past decade, besides the development of Neural Networks (NNs), the community has also relentlessly explored nature-powered ML paradigms. Although most of them are still predominantly theoretical, a new practical paradigm enabled by the recent advent of CMOS-compatible room-temperature nature-based computers has emerged. By harnessing a dynamical system's intrinsic behavior of chasing the lowest energy state, this paradigm can solve some simple binary problems delivering considerable speedup and energy savings compared with NNs, while maintaining comparable accuracy. Regrettably, its values to the real world are highly constrained by its binary nature. A clear pathway to its extension to real-valued problems remains elusive. This paper aims to unleash this pathway by proposing a novel end-to-end Nature-Powered Graph Learning (NP-GL) framework. Specifically, through a three-dimensional co-design, NP-GL can leverage the spontaneous energy decrease in nature to efficiently solve real-valued graph learning problems. Experimental results across 4 real-world applications with 6 datasets demonstrate that NP-GL delivers, on average, 6.97 × 10 3 speedup and 10 5 energy consumption reduction with comparable or even higher accuracy than Graph Neural Networks (GNNs).
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Solving Time-Dependent Differential Equations with Physical Dynamical SystemsChuan Liu, Yijie Chen, Ruibing Song, Wenhao Huang 等ICML 2026
- Provable Convergence Bounds for Hybrid Dynamical Sampling and OptimizationMatthew X. Burns, Qingyuan Hou, Michael C. HuangICLR 2025
- DS-LLM: Leveraging Dynamical Systems to Enhance Both Training and Inference of Large Language ModelsRuibing Song, Chuan Liu, Chunshu Wu, Ang Li 等ICLR 2025
- InstaTrain: Adaptive Training via Ultra-Fast Natural Annealing within Dynamical SystemsChuan Liu, Ruibing Song, Chunshu Wu, Pouya Haghi 等ICLR 2025
- An Expressive and Self-Adaptive Dynamical System for Efficient Function LearningChuan Liu, Chunshu Wu, Ruibing Song, Ang Li 等ICML 2025
它引用的顶会 Paper7
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang 等KDD 2020 · 被引用 1,738 次
- Spatio-Temporal Meta-Graph Learning for Traffic ForecastingRenhe Jiang, Zhaonan Wang, Jiawei Yong, Puneet Jeph 等AAAI 2023 · 被引用 336 次
- BRIM: Bistable Resistively-Coupled Ising MachineRichard Afoakwa, Yiqiao Zhang, Uday Kumar Reddy Vengalam, Zeljko Ignjatovic 等HPCA 2021 · 被引用 57 次
- Ising-Traffic: Using Ising Machine Learning to Predict Traffic Congestion under UncertaintyZhenyu Pan, Anshujit Sharma, Jerry Yao-Chieh Hu, Zhuo Liu 等AAAI 2023 · 被引用 43 次
- Increasing ising machine capacity with multi-chip architecturesAnshujit Sharma, Richard Afoakwa, Zeljko Ignjatovic, Michael C. HuangISCA 2022 · 被引用 28 次
相关 Paper
- DS-GL: Advancing Graph Learning via Harnessing Nature's Power within Scalable Dynamical SystemsRuibing Song, Chunshu Wu, Chuan Liu, Ang Li 等ISCA 2024 · 被引用 6 次
- DS-TPU: Dynamical System for on-Device Lifelong Graph Learning with Nonlinear Node InteractionChunshu Wu, Ruibing Song, Chuan Liu, Pouya Haghi 等ISCA 2025 · 被引用 3 次
- Supporting Energy-based Learning with an Ising Machine substrate: a Case Study on RBMUday Kumar Reddy Vengalam, Yongchao Liu, Tong Geng, Hui Wu 等MICRO 2023 · 被引用 8 次
- TLPGNN: A Lightweight Two-Level Parallelism Paradigm for Graph Neural Network Computation on GPUQiang Fu, Yuede Ji, H. Howie HuangHPDC 2022 · 被引用 19 次
- Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node EmbeddingsYu Chen, Lingfei Wu, Mohammed J. ZakiNeurIPS 2020 · 被引用 559 次
