Vertical Federated Feature Screening
Huajun Yin, Liyuan Wang, Yingqiu Zhu, Liping Zhu, Danyang Huang
Abstract
With the rapid development of the big data era, Vertical Federated Learning (VFL) has been widely applied to enable data collaboration while ensuring privacy protection. However, the ultrahigh dimensionality of features and the sparse data structures inherent in large-scale datasets introduce significant computational complexity. In this paper, we propose the Vertical Federated Feature Screening (VFS) algorithm, which effectively reduces computational, communication, and encryption costs. VFS is a two-stage feature screening procedure that proceeds from coarse to fine: the first stage quickly filters out irrelevant feature groups, followed by a more refined screening of individual features. It significantly reduces the resource demands of downstream tasks such as secure joint modeling or federated feature selection. This efficiency is particularly beneficial in scenarios with ultra-high feature dimensionality or severe class imbalance in the response variable. The statistical and computational properties of VFS are rigorously established. Numerical simulations and real-world applications demonstrate its superior performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on10
- CrypTen: Secure Multi-Party Computation Meets Machine LearningBrian Knott, Shobha Venkataraman, Awni Y. Hannun, Shubho Sengupta et al.NeurIPS 2021 · 573 citations
- Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned DataTimothy J. Castiglia, Anirban Das, Shiqiang Wang, Stacy PattersonICML 2022 · 72 citations
- Securing Approximate Homomorphic Encryption Using Differential PrivacyBaiyu Li, Daniele Micciancio, Mark Schultz, Jessica SorrellCRYPTO 2022 · 55 citations
- FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated LearningAnran Li, Hongyi Peng, Lan Zhang, Jiahui Huang et al.INFOCOM 2023 · 50 citations
- Falcon: A Privacy-Preserving and Interpretable Vertical Federated Learning SystemYuncheng Wu, Naili Xing, Gang Chen, Tien Tuan Anh Dinh et al.VLDB 2023 · 47 citations
Related papers
- LESS-VFL: Communication-Efficient Feature Selection for Vertical Federated LearningTimothy Castiglia, Yi Zhou, Shiqiang Wang, Swanand Kadhe et al.ICML 2023 · 33 citations
- Coresets for Vertical Federated Learning: Regularized Linear Regression and -Means ClusteringLingxiao Huang, Zhize Li, Jialin Sun, Haoyu ZhaoNeurIPS 2022 · 31 citations
- VertiBench: Advancing Feature Distribution Diversity in Vertical Federated Learning BenchmarksZhaomin Wu, Junyi Hou, Bingsheng HeICLR 2024 · 7 citations
- FEAST: A Communication-efficient Federated Feature Selection Framework for Relational DataRui Fu, Yuncheng Wu, Quanqing Xu, Meihui ZhangSIGMOD 2023 · 17 citations
- BlindFL: Vertical Federated Machine Learning without Peeking into Your DataFangcheng Fu, Huanran Xue, Yong Cheng, Yangyu Tao et al.SIGMOD 2022 · 53 citations
