Tasks of a Different Color: How Crowdsourcing Practices Differ per Complex Task Type and Why This Matters
Yihong Wang, Konstantinos Papangelis, Ioanna Lykourentzou, Michael Saker, Alan Chamberlain, Vassilis-Javed Khan, Hai-Ning Liang, Yong Yue
Abstract
Crowdsourcing in China is a thriving industry. Among its most interesting structures, we find crowdfarms, in which crowdworkers self-organize as small organizations to tackle macrotasks. Little, however, is known as to which practices these crowdfarms use to tackle the macrotasks, and this goes hand in hand with the current practice of the HCI research community to treat all forms of complex crowdsourcing work as practically the same. However, macrotasks differ substantially regarding structure and decomposability. Treating them under one umbrella term - macrotasking - can lead to an imprecise understanding of the workforce involved. We address this gap by examining the work practices of 31 Chinese crowdfarms on the four main macrotask types, namely: modular, interlaced, wicked, and container macrotasks. Our results confirm essential differences in how these nascent crowd organizations address different macrotasks and shed light on what platforms can do to improve the uptake of such work.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Related papers
- An Examination of the Work Practices of CrowdfarmsYihong Wang, Konstantinos Papangelis, Michael Saker, Ioanna Lykourentzou et al.CHI 2021 · 9 citations
- Crowdsourcing in China: Exploring the Work Experiences of Solo Crowdworkers and Crowdfarm WorkersYihong Wang, Konstantinos Papangelis, Michael Saker, Ioanna Lykourentzou et al.CHI 2020 · 18 citations
- CrowdMOT: Crowdsourcing Strategies for Tracking Multiple Objects in VideosSamreen Anjum, Chi Lin, Danna GurariCSCW 2020 · 5 citations
- Collaboration, Invisible Work, and The Costs of Macrotask FreelancingSrihari Hulikal Muralidhar, Sean Rintel, Siddharth SuriCSCW 2022 · 11 citations
- Label Aggregation for Composite Crowd Tasks by Worker Ability Constraint SatisfactionJiyi LiAAAI 2025 · 1 citation
