"Hi! I am the Crowd Tasker" Crowdsourcing through Digital Voice Assistants
Danula Hettiachchi, Zhanna Sarsenbayeva, Fraser Allison, Niels van Berkel, Tilman Dingler, Gabriele Marini, Vassilis Kostakos, Jorge Gonçalves
Abstract
Inspired by the increasing prevalence of digital voice assistants, we demonstrate the feasibility of using voice interfaces to deploy and complete crowd tasks. We have developed Crowd Tasker, a novel system that delivers crowd tasks through a digital voice assistant. In a lab study, we validate our proof-of-concept and show that crowd task performance through a voice assistant is comparable to that of a web interface for voice-compatible and voice-based crowd tasks for native English speakers. We also report on a field study where participants used our system in their homes. We find that crowdsourcing through voice can provide greater flexibility to crowd workers by allowing them to work in brief sessions, enabling multi-tasking, and reducing the time and effort required to initiate tasks. We conclude by proposing a set of design guidelines for the creation of crowd tasks for voice and the development of future voice-based crowdsourcing systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 62ee0ca9-15fb-4e17-8794-eed19beaa2e2Cited by top-tier papers7
- What Could Possibly Go Wrong When Interacting with Proactive Smart Speakers? A Case Study Using an ESM ApplicationJing Wei, Benjamin Tag, Johanne R. Trippas, Tilman Dingler et al.CHI 2022 · 45 citations
- CrowdCog: A Cognitive Skill based System for Heterogeneous Task Assignment and Recommendation in CrowdsourcingDanula Hettiachchi, Niels van Berkel, Vassilis Kostakos, Jorge GonçalvesCSCW 2020 · 38 citations
- Firefox Voice: An Open and Extensible Voice Assistant Built Upon the WebJulia Cambre, Alex C. Williams, Afsaneh Razi, Ian Bicking et al.CHI 2021 · 38 citations
- Understanding User Perceptions of Proactive Smart SpeakersJing Wei, Tilman Dingler, Vassilis KostakosUbiComp 2022 · 33 citations
- Understanding How to Administer Voice Surveys through Smart SpeakersJing Wei, Weiwei Jiang, Chaofan Wang, Difeng Yu et al.CSCW 2022 · 9 citations
Related papers
- Improving Worker Engagement Through Conversational Microtask CrowdsourcingSihang Qiu, Ujwal Gadiraju, Alessandro BozzonCHI 2020 · 66 citations
- Hear Me Out: A Study on the Use of the Voice Modality for Crowdsourced Relevance AssessmentsNirmal Roy, Agathe Balayn, David Maxwell, Claudia HauffSIGIR 2023 · 1 citation
- Keep it Short: A Comparison of Voice Assistants' Response BehaviorGabriel Haas, Michael Rietzler, Matt Jones, Enrico RukzioCHI 2022 · 37 citations
- Estimating Conversational Styles in Conversational Microtask CrowdsourcingSihang Qiu, Ujwal Gadiraju, Alessandro BozzonCSCW 2020 · 19 citations
- CrowdSurfer: Seamlessly Integrating Crowd-Feedback Tasks into Everyday Internet SurfingSaskia Haug, Ivo Benke, Daniel Fischer, Alexander MaedcheCHI 2023 · 3 citations
