Data Poisoning Attacks and Defenses to Crowdsourcing Systems
Minghong Fang, Minghao Sun, Qi Li, Neil Zhenqiang Gong, Jin Tian, Jia Liu
Abstract
A key challenge of big data analytics is how to collect a large volume of (labeled) data. Crowdsourcing aims to address this challenge via aggregating and estimating high-quality data (e.g., sentiment label for text) from pervasive clients/users. Existing studies on crowdsourcing focus on designing new methods to improve the aggregated data quality from unreliable/noisy clients. However, the security aspects of such crowdsourcing systems remain underexplored to date. We aim to bridge this gap in this work. Specifically, we show that crowdsourcing is vulnerable to data poisoning attacks, in which malicious clients provide carefully crafted data to corrupt the aggregated data. We formulate our proposed data poisoning attacks as an optimization problem that maximizes the error of the aggregated data. Our evaluation results on one synthetic and two real-world benchmark datasets demonstrate that the proposed attacks can substantially increase the estimation errors of the aggregated data. We also propose two defenses to reduce the impact of malicious clients. Our empirical results show that the proposed defenses can substantially reduce the estimation errors of the data poisoning attacks. CCS CONCEPTS • Security and privacy → Systems security.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e38d2659-e549-4a62-8d0d-9bee56648a1fCited by top-tier papers9
- Poisoning Federated Recommender Systems with Fake UsersMing Yin, Yichang Xu, Minghong Fang, Neil Zhenqiang GongWWW 2024 · 32 citations
- Adversarial Learning from CrowdsPengpeng Chen, Hailong Sun, Yongqiang Yang, Zhijun ChenAAAI 2022 · 16 citations
- The Price of Tailoring the Index to Your Data: Poisoning Attacks on Learned Index StructuresEvgenios M. Kornaropoulos, Silei Ren, Roberto TamassiaSIGMOD 2022 · 13 citations
- Tracing Back the Malicious Clients in Poisoning Attacks to Federated LearningYuqi Jia, Minghong Fang, Hongbin Liu, Jinghuai Zhang et al.NeurIPS 2025 · 8 citations
- Curriculum Graph PoisoningHanwen Liu, Peilin Zhao, Tingyang Xu, Yatao Bian et al.WWW 2023 · 3 citations
Builds on4
- Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression LearningMatthew Jagielski, Alina Oprea, Battista Biggio, Chang Liu et al.S&P 2018 · 867 citations
- Fake Co-visitation Injection Attacks to Recommender SystemsGuolei Yang, Neil Zhenqiang Gong, Ying CaiNDSS 2017 · 126 citations
- FLTrust: Byzantine-robust Federated Learning via Trust BootstrappingXiaoyu Cao, Minghong Fang, Jia Liu, Neil Zhenqiang GongNDSS 2021
- Local Model Poisoning Attacks to Byzantine-Robust Federated LearningMinghong Fang, Xiaoyu Cao, Jinyuan Jia, Neil Zhenqiang GongUSENIX Security 2020
Related papers
- Truth Discovery against Strategic Sybil Attack in CrowdsourcingYue Wang, Ke Wang, Chunyan MiaoKDD 2020 · 25 citations
- Data Poisoning Attacks to Local Differential Privacy ProtocolsXiaoyu Cao, Jinyuan Jia, Neil Zhenqiang GongUSENIX Security 2021 · 100 citations
- Fine-grained Poisoning Attack to Local Differential Privacy Protocols for Mean and Variance EstimationXiaoguang Li, Ninghui Li, Wenhai Sun, Neil Zhenqiang Gong et al.USENIX Security 2023
- Temporal Robustness against Data poisoningWenxiao Wang, Soheil FeiziNeurIPS 2023 · 17 citations
- Data Poisoning Attacks to Locally Differentially Private Frequent Itemset Mining ProtocolsWei Tong, Haoyu Chen, Jiacheng Niu, Sheng ZhongCCS 2024 · 2 citations
