Becoming the Super Turker: Increasing Wages via a Strategy from High Earning Workers
Saiph Savage, Chun-Wei Chiang, Susumu Saito, Carlos Toxtli, Jeffrey P. Bigham
Abstract
Crowd markets have traditionally limited workers by not providing transparency information concerning which tasks pay fairly or which requesters are unreliable. Researchers believe that a key reason why crowd workers earn low wages is due to this lack of transparency. As a result, tools have been developed to provide more transparency within crowd markets to help workers. However, while most workers use these tools, they still earn less than minimum wage. We argue that the missing element is guidance on how to use transparency information. In this paper, we explore how novice workers can improve their earnings by following the transparency criteria of Super Turkers, i.e., crowd workers who earn higher salaries on Amazon Mechanical Turk (MTurk). We believe that Super Turkers have developed effective processes for using transparency information. Therefore, by having novices follow a Super Turker criteria (one that is simple and popular among Super Turkers), we can help novices increase their wages. For this purpose, we: (i) conducted a survey and data analysis to computationally identify a simple yet common criteria that Super Turkers use for handling transparency tools; (ii) deployed a two-week field experiment with novices who followed this Super Turker criteria to find better work on MTurk. Novices in our study viewed over 25,000 tasks by 1,394 requesters. We found that novices who utilized this Super Turkers’ criteria earned better wages than other novices. Our results highlight that tool development to support crowd workers should be paired with educational opportunities that teach workers how to effectively use the tools and their related metrics (e.g., transparency values). We finish with design recommendations for empowering crowd workers to earn higher salaries.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4db6207f-7260-4e34-875f-198d612ebe6dCited by top-tier papers12
- Quantifying the Invisible Labor in Crowd WorkCarlos Toxtli, Siddharth Suri, Saiph SavageCSCW 2021 · 91 citations
- Creator-friendly Algorithms: Behaviors, Challenges, and Design Opportunities in Algorithmic PlatformsYoonseo Choi, Eun Jeong Kang, Min Kyung Lee, Juho KimCHI 2023 · 35 citations
- Designing Gig Worker Sousveillance ToolsKimberly Do, Maya De Los Santos, Michael Muller, Saiph SavageCHI 2024 · 29 citations
- I Want to, but First I Need to: Understanding Crowdworkers' Career Goals, Challenges, and TensionsVeronica A. Rivera, David T. LeeCSCW 2021 · 25 citations
- The Challenge of Variable Effort Crowdsourcing and How Visible Gold Can HelpDanula Hettiachchi, Mike Schaekermann, Tristan McKinney, Matthew LeaseCSCW 2021 · 21 citations
Related papers
- The Expertise Involved in Deciding which HITs are Worth Doing on Amazon Mechanical TurkBenjamin V. Hanrahan, Anita Chen, Jiahua Ma, Ning F. Ma et al.CSCW 2021 · 16 citations
- Incorporating Worker Perspectives into MTurk Annotation Practices for NLPOlivia Huang, Eve Fleisig, Dan KleinEMNLP 2023 · 1 citation
- Playing Planning Poker in Crowds: Human Computation of Software Effort EstimatesMohammed Alhamed, Tim StorerICSE 2021 · 18 citations
- How Low is Low? Crowdworker Perceptions of Microtask Payments in Work versus Leisure SituationsLing Jiang, Christian WagnerCHI 2024 · 2 citations
- A Needle in a Haystack: An Analysis of High-Agreement Workers on MTurk for SummarizationLining Zhang, Simon Mille, Yufang Hou, Daniel Deutsch et al.ACL 2023 · 6 citations
