Improving Meeting Inclusiveness using Speech Interruption Analysis
Szu-Wei Fu, Yaran Fan, Yasaman Hosseinkashi, Jayant Gupchup, Ross Cutler
Abstract
Meetings are a pervasive method of communication within all types of companies and organizations, and using remote collaboration systems to conduct meetings has increased dramatically since the COVID-19 pandemic. However, not all meetings are inclusive, especially in terms of the participation rates among attendees. In a recent large-scale survey conducted at Microsoft, the top suggestion given by meeting participants for improving inclusiveness is to improve the ability of remote participants to interrupt and acquire the floor during meetings. We show that the use of the virtual raise hand (VRH) feature can lead to an increase in predicted meeting inclusiveness at Microsoft. One challenge is that VRH is used in less than of all meetings. In order to drive adoption of its usage to improve inclusiveness (and participation), we present a machine learning-based system that predicts when a meeting participant attempts to obtain the floor, but fails to interrupt (termed a 'failed interruption'). This prediction can be used to nudge the user to raise their virtual hand within the meeting. We believe this is the first failed speech interruption detector, and the performance on a realistic test set has an area under curve (AUC) of 0.95 with a true positive rate (TPR) of 50% at a false positive rate (FPR) of 1%. To our knowledge, this is also the first dataset of interruption categories (including the failed interruption category) for remote meetings. Finally, we believe this is the first such system designed to improve meeting inclusiveness through speech interruption analysis and active intervention.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on2
- wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael AuliNeurIPS 2020 · 9,451 citations
- Meeting Effectiveness and Inclusiveness in Remote CollaborationRoss Cutler, Yasaman Hosseinkashi, Jamie Pool, Senja Filipi et al.CSCW 2021 · 34 citations
Related papers
- Online Mingling: Supporting Ad Hoc, Private Conversations at Virtual ConferencesJaeyoon Song, Christoph Riedl, Thomas W. MaloneCHI 2021 · 24 citations
- Large Scale Analysis of Multitasking Behavior During Remote MeetingsHancheng Cao, Chia-Jung Lee, Shamsi T. Iqbal, Mary Czerwinski et al.CHI 2021 · 139 citations
- OpenMic: Utilizing Proxemic Metaphors for Conversational Floor Transitions in Multiparty Video MeetingsErzhen Hu, Jens Emil Sloth Grønbæk, Austin Houck, Seongkook HeoCHI 2023 · 18 citations
- Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing PairsMatthew Seita, Sooyeon Lee, Sarah Andrew, Kristen Shinohara et al.CHI 2022 · 51 citations
- "It's Not an Issue of Malice, but of Ignorance": Towards Inclusive Video Conferencing for Presenters Who are d/Deaf or Hard of HearingJosh Urban Davis, Hongwei Wang, Parmit K. Chilana, Xing-Dong YangUbiComp 2023 · 2 citations
