Firefox Voice: An Open and Extensible Voice Assistant Built Upon the Web
Julia Cambre, Alex C. Williams, Afsaneh Razi, Ian Bicking, Abraham Wallin, Janice Y. Tsai, Chinmay Kulkarni, Jofish Kaye
Abstract
Voice assistants are fundamentally changing the way we access information. However, voice assistants still leverage little about the web beyond simple search results. We introduce Firefox Voice, a novel voice assistant built on the open web ecosystem with an aim to expand access to information available via voice. Firefox Voice is a browser extension that enables users to use their voice to perform actions such as setting timers, navigating the web, and reading a webpage’s content aloud. Through an iterative development process and use by over 12,000 active users, we find that users see voice as a way to accomplish certain browsing tasks efficiently, but struggle with discovering functionality and frequently discontinue use. We conclude by describing how Firefox Voice enables the development of novel, open web-powered voice-driven experiences.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f473e5d7-3f59-4ea0-9d43-df3ebb19ef02Cited by top-tier papers7
- What Could Possibly Go Wrong When Interacting with Proactive Smart Speakers? A Case Study Using an ESM ApplicationJing Wei, Benjamin Tag, Johanne R. Trippas, Tilman Dingler et al.CHI 2022 · 45 citations
- Defining Patterns for a Conversational WebEmanuele Pucci, Isabella Possaghi, Claudia Maria Cutrupi, Marcos Báez et al.CHI 2023 · 29 citations
- "This machine is for the aides": Tailoring Voice Assistant Design to Home Health Care WorkVince Bartle, Liam Albright, Nicola DellCHI 2023 · 19 citations
- GPTVoiceTasker: Advancing Multi-step Mobile Task Efficiency Through Dynamic Interface Exploration and LearningMinh Duc Vu, Han Wang, Jieshan Chen, Zhuang Li et al.UIST 2024 · 17 citations
- Creepy Assistant: Development and Validation of a Scale to Measure the Perceived Creepiness of Voice AssistantsRachel Phinnemore, Mohi Reza, Blaine Lewis, Karthik Mahadevan et al.CHI 2023 · 17 citations
Builds on5
- Parenting with Alexa: Exploring the Introduction of Smart Speakers on Family DynamicsErin Beneteau, Ashley Boone, Yuxing Wu, Julie A. Kientz et al.CHI 2020 · 134 citations
- Choice of Voices: A Large-Scale Evaluation of Text-to-Speech Voice Quality for Long-Form ContentJulia Cambre, Jessica Colnago, Jim Maddock, Janice Y. Tsai et al.CHI 2020 · 65 citations
- Experiential Qualities of Whispering with Voice AssistantsEmmi Parviainen, Marie Louise Juul SøndergaardCHI 2020 · 52 citations
- "Hi! I am the Crowd Tasker" Crowdsourcing through Digital Voice AssistantsDanula Hettiachchi, Zhanna Sarsenbayeva, Fraser Allison, Niels van Berkel et al.CHI 2020 · 22 citations
- Geno: A Developer Tool for Authoring Multimodal Interaction on Existing Web ApplicationsRitam Jyoti Sarmah, Yunpeng Ding, Di Wang, Cheuk Yin Phipson Lee et al.UIST 2020 · 19 citations
Related papers
- Fuse: In-Situ Sensemaking Support in the BrowserAndrew Kuznetsov, Joseph Chee Chang, Nathan Hahn, Napol Rachatasumrit et al.UIST 2022 · 29 citations
- Exploring Interactive Sound Design for Auditory WebsitesLotus Zhang, Jingyao Shao, Augustina Ao Liu, Lucy Jiang et al.CHI 2022 · 14 citations
- Optimally Summarizing Data by Small Fact Sets for Concise Answers to Voice QueriesImmanuel Trummer, Connor AndersonICDE 2021 · 3 citations
- Facilitating Proactive and Reactive Guidance for Decision Making on the Web: A Design Probe with WebSeekYanwei Huang, Arpit NarechaniaCHI 2026 · 2 citations
- VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-InAther Sharif, Olivia H. Wang, Alida T. Muongchan, Katharina Reinecke et al.CHI 2022 · 88 citations
