Equilibrium-Driven Vertical Federated Learning with Selective Privacy Protection
Yuanzhe Peng, Wenwei Zhao, Zhuo Lu, Jie Xu
Abstract
Vertical Federated Learning (VFL) enables multiple clients with feature-partitioned data to collaboratively train models while preserving privacy by transmitting embeddings instead of raw data. However, such embeddings can still expose sensitive attributes (e.g., gender or race) unrelated to the target task, making them vulnerable to attribute inference attacks. Most existing privacy strategies may provide extra protection, but at the cost of reduced accuracy and excessive privacy budget. In this paper, we propose a novel equilibrium-driven VFL framework with selective privacy protection for sensitive attributes that are difficult to isolate from embeddings, thereby enhancing local privacy with minor accuracy compromise. We introduce two key innovations: (1) a NashCoder, which incorporates a surrogate head to jointly optimize accuracy and privacy; (2) an adaptive decomposition strategy based on Shapley values, which dynamically decomposes the global objective for distributed optimization from an equilibrium perspective. We theoretically analyze our framework and empirically evaluate it on three public datasets against five baselines, demonstrating significant improvements in the accuracy-privacy trade-off under various privacy settings. Extensive experimental results support our theoretical analysis.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 341e9b32-5ea3-4f11-b984-dbb3bb9418c5Builds on8
- Feature Inference Attack on Model Predictions in Vertical Federated LearningXinjian Luo, Yuncheng Wu, Xiaokui Xiao, Beng Chin OoiICDE 2021 · 212 citations
- Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned DataTimothy J. Castiglia, Anirban Das, Shiqiang Wang, Stacy PattersonICML 2022 · 72 citations
- TIPRDC: Task-Independent Privacy-Respecting Data Crowdsourcing Framework for Deep Learning with Anonymized Intermediate RepresentationsAng Li, Yixiao Duan, Huanrui Yang, Yiran Chen et al.KDD 2020 · 54 citations
- FedVS: Straggler-Resilient and Privacy-Preserving Vertical Federated Learning for Split ModelsSongze Li, Duanyi Yao, Jin LiuICML 2023 · 49 citations
- LESS-VFL: Communication-Efficient Feature Selection for Vertical Federated LearningTimothy Castiglia, Yi Zhou, Shiqiang Wang, Swanand Kadhe et al.ICML 2023 · 33 citations
Related papers
- Preventing Strategic Behaviors in Collaborative Inference for Vertical Federated LearningYidan Xing, Zhenzhe Zheng, Fan WuKDD 2024 · 1 citation
- FairVFL: A Fair Vertical Federated Learning Framework with Contrastive Adversarial LearningTao Qi, Fangzhao Wu, Chuhan Wu, Lingjuan Lyu et al.NeurIPS 2022 · 51 citations
- Aegis: Post-Training Attribute Unlearning in Federated Recommender Systems against Attribute Inference AttacksWenhan Wu, Jiawei Jiang, Chuang HuWWW 2025 · 4 citations
- FedAU2: Attribute Unlearning for User-Level Federated Recommender Systems with Adaptive and Robust Adversarial TrainingYuyuan Li, Junjie Fang, Fengyuan Yu, Xichun Sheng et al.AAAI 2026 · 1 citation
- Falcon: A Privacy-Preserving and Interpretable Vertical Federated Learning SystemYuncheng Wu, Naili Xing, Gang Chen, Tien Tuan Anh Dinh et al.VLDB 2023 · 47 citations
