Accelerated Vertical Federated Adversarial Learning through Decoupling Layer-Wise Dependencies
Tianxing Man, Yu Bai, Ganyu Wang, Jinjie Fang, Haoran Fang, Bin Gu, Yi Chang
摘要
Vertical Federated Learning (VFL) enables participants to collaboratively train models on aligned samples while keeping their heterogeneous features private and distributed. Despite their utility, VFL models remain vulnerable to adversarial attacks during inference. Adversarial Training (AT), which generates adversarial examples at each training iteration, stands as the most effective defense for improving model robustness. However, applying AT in VFL settings (VFAL) faces significant computational efficiency challenges, as the distributed training framework necessitates iterative propagations across participants. To this end, we propose DecVFAL framework, which substantially accelerates VFAL training through a dual-level Dec oupling mechanism applied during adversarial sample generation. Specifically, we first decouple the bottom modules of clients (directly responsible for adversarial updates) from the remaining networks, enabling efficient lazy sequential propagations that reduce communication frequency through delayed gradients. We further introduce decoupled parallel backpropagation to accelerate delayed gradient computation by eliminating idle waiting through parallel processing across modules. Additionally, we are the first to establish convergence analysis for VFAL, rigorously characterizing how our decoupling mechanism interacts with existing VFL dynamics, and prove that DecVFAL achieves an O (1 / √ K ) convergence rate matching that of standard VFLs. Experimental results show that DecVFAL ensures competitive robustness while significantly achieving about 3 ∼ 10 × speed up.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- Towards Evaluating the Robustness of Neural NetworksNicholas Carlini, David A. WagnerS&P 2017 · 被引用 9,786 次
- Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacksFrancesco Croce, Matthias HeinICML 2020 · 被引用 2,337 次
- Fast is better than free: Revisiting adversarial trainingEric Wong, Leslie Rice, J. Zico KolterICLR 2020 · 被引用 1,352 次
- FreeLB: Enhanced Adversarial Training for Natural Language UnderstandingChen Zhu, Yu Cheng, Zhe Gan, Siqi Sun 等ICLR 2020 · 被引用 502 次
- Feature Inference Attack on Model Predictions in Vertical Federated LearningXinjian Luo, Yuncheng Wu, Xiaokui Xiao, Beng Chin OoiICDE 2021 · 被引用 212 次
相关 Paper
- Federated Adversarial Learning: A Framework with Convergence AnalysisXiaoxiao Li, Zhao Song, Jiaming YangICML 2023 · 被引用 36 次
- VFLAIR: A Research Library and Benchmark for Vertical Federated LearningTianyuan Zou, Zixuan Gu, Yu He, Hideaki Takahashi 等ICLR 2024 · 被引用 15 次
- TVFL: Tunable Vertical Federated Learning towards Communication-Efficient Model ServingJunhao Wang, Lan Zhang, Yihang Cheng, Shaoang Li 等INFOCOM 2023 · 被引用 10 次
- Secure Bilevel Asynchronous Vertical Federated Learning with Backward UpdatingQingsong Zhang, Bin Gu, Cheng Deng, Heng HuangAAAI 2021 · 被引用 81 次
- Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local UpdateFangcheng Fu, Xupeng Miao, Jiawei Jiang, Huanran Xue 等VLDB 2022 · 被引用 31 次
