Double Stochasticity Gazes Faster: Snap-Shot Decentralized Stochastic Gradient Tracking Methods
Hao Di, Haishan Ye, Xiangyu Chang, Guang Dai, Ivor W. Tsang
2024Year
4Citations
3Top-tier citations
Abstract
date SS DSGT's superior performance in the general communication network topology and exhibit better practical performance of ASS DSGT on the specified W compared to DSGT.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Improved Convergence Analysis of Topology Dependence in Decentralized SGDYuki Takezawa, Anastasiia Koloskova, Sebastian StichICML 2026
- Towards Faster Decentralized Stochastic Optimization with Communication CompressionRustem Islamov, Yuan Gao, Sebastian U. StichICLR 2025
- Scalable Decentralized Learning with TeleportationYuki Takezawa, Sebastian U. StichICLR 2025
Builds on5
- A Unified Theory of Decentralized SGD with Changing Topology and Local UpdatesAnastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi et al.ICML 2020 · 623 citations
- An Improved Analysis of Gradient Tracking for Decentralized Machine LearningAnastasia Koloskova, Tao Lin, Sebastian U. StichNeurIPS 2021 · 148 citations
- Optimal Complexity in Decentralized TrainingYucheng Lu, Christopher De SaICML 2021 · 95 citations
- Decentralized Accelerated Proximal Gradient DescentHaishan Ye, Ziang Zhou, Luo Luo, Tong ZhangNeurIPS 2020 · 37 citations
- Asynchronous Decentralized Online LearningJiyan Jiang, Wenpeng Zhang, Jinjie Gu, Wenwu ZhuNeurIPS 2021 · 26 citations
Related papers
- Scaffold-GS: Structured 3D Gaussians for View-Adaptive RenderingTao Lu, Mulin Yu, Linning Xu, Yuanbo Xiangli et al.CVPR 2024
- sfXHMQV: Better Efficiency and Stronger Security for Signal's Initial Handshake based on HMQVRune Fiedler, Felix Günther, Jiaxin Pan, Runzhi ZengCRYPTO 2025 · 2 citations
- Depth Estimation from Indoor Panoramas with Neural Scene RepresentationWenjie Chang, Yueyi Zhang, Zhiwei XiongCVPR 2023
- MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized AdaptationBowen Zhang, Chenyang Qi, Pan Zhang, Bo Zhang et al.CVPR 2023
- Asymmetric Group Message Franking: Definitions and ConstructionsJunzuo Lai, Gongxian Zeng, Zhengan Huang, Siu Ming Yiu et al.EUROCRYPT 2023 · 7 citations
