Insights from an Experiment Crowdsourcing Data from Thousands of US Amazon Users: The importance of transparency, money, and data use
Alex Berke, Robert Mahari, Alex Pentland, Kent Larson, Dana Calacci
Abstract
Data generated by users on digital platforms are a crucial resource for advocates and researchers interested in uncovering digital inequities, auditing algorithms, and understanding human behavior. Yet data access is often restricted. How can researchers both effectively and ethically collect user data? This paper shares an innovative approach to crowdsourcing user data to collect otherwise inaccessible Amazon purchase histories, spanning 5 years, from more than 5,000 U.S. users. We developed a data collection tool that prioritizes participant consent and includes an experimental study design. The design allows us to study multiple important aspects of privacy perception and user data sharing behavior, including how socio-demographics, monetary incentives and transparency can impact share rates. Experiment results (N=6,325) reveal both monetary incentives and transparency can significantly increase data sharing. Age, race, education, and gender also played a role, where female and less-educated participants were more likely to share. Our study design enables a unique empirical evaluation of the "privacy paradox", where users claim to value their privacy more than they do in practice. We set up both real and hypothetical data sharing scenarios and find measurable similarities and differences in share rates across these contexts. For example, increasing monetary incentives had a 6 times higher impact on share rates in real scenarios. In addition, we study participants' opinions on how data should be used by various third parties, again finding that gender, age, education, and race have a significant impact. Notably, the majority of participants disapproved of government agencies using purchase data yet the majority approved of use by researchers. Overall, our findings highlight the critical role that transparency, incentive design, and user demographics play in ethical data collection practices, and provide guidance for future researchers seeking to crowdsource user generated data.
CCS Concepts: • Human-centered computing → Empirical studies in collaborative and social computing; • Security and privacy → Economics of security and privacy; Social aspects of security and privacy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ead48969-0305-4a72-a53a-bd4df94781a9Cited by top-tier papers1
Ask how each one uses itBuilds on3
- Bargaining with the Black-Box: Designing and Deploying Worker-Centric Tools to Audit Algorithmic ManagementDan Calacci, Alex PentlandCSCW 2022 · 57 citations
- Privacy Limitations of Interest-based Advertising on The Web: A Post-mortem Empirical Analysis of Google's FLoCAlex Berke, Dan CalacciCCS 2022 · 8 citations
- Does This Button Work? Investigating YouTube's Ineffective User ControlsJesse McCrosky, Ranadheer Malla, Aapo Tanskanen, Chico Q. CamargoWWW 2026 · 6 citations
Related papers
- "I know even if you don't tell me": Understanding Users' Privacy Preferences Regarding AI-based Inferences of Sensitive Information for PersonalizationSumit Asthana, Jane Im, Zhe Chen, Nikola BanovicCHI 2024 · 33 citations
- Understanding Risks of Privacy Theater with Differential PrivacyMary Anne Smart, Dhruv Sood, Kristen VaccaroCSCW 2022 · 27 citations
- Users' Perceptions of Online Child Abuse Detection MechanismsElmira Deldari, Parth Kirankumar Thakkar, Yaxing YaoCSCW 2024 · 6 citations
- Is this AI trained on Credible Data? The Effects of Labeling Quality and Performance Bias on User TrustCheng Chen, S. Shyam SundarCHI 2023 · 36 citations
- Incorporating Worker Perspectives into MTurk Annotation Practices for NLPOlivia Huang, Eve Fleisig, Dan KleinEMNLP 2023 · 1 citation
