Exploring Reduced Feature Sets for American Sign Language Dictionaries
Ben Kosa, Aashaka Desai, Alex X. Lu, Richard E. Ladner, Danielle Bragg
Abstract
There is currently no easy way to look up signs in sign language. Feature-based dictionaries help overcome this challenge by enabling users to look up a sign by inputting descriptive visual features, such as handshape and movement. However, feature-based dictionaries are typically cumbersome, including large numbers of complex features that the user must sort through. In this work, we explore simplifying the set of features used in feature-based American Sign Language (ASL) dictionaries. We present two studies: 1) a simulation study focused on lookup accuracy for various reduced feature sets, and 2) a user study focused on understanding human preferences between feature sets. Our results suggest that it is possible to dramatically reduce the number of features needed to search for signs without significantly impacting the accuracy of search results, and that smaller feature sets can improve the user experience in some cases.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Reimagining Sign Language Technologies: Analyzing Translation Work of Chinese Deaf Online Content CreatorsXinru Tang, Anne Marie PiperCHI 2026 · 2 citations
- ASL Educators' Perspectives on AI for Enhancing Student Learning in American Sign Language EducationSaad Hassan, Laleh Nourian, Caluã de Lacerda Pataca, Michelle M. Olson et al.CHI 2026 · 1 citation
Builds on1
Related papers
- Design and Evaluation of Hybrid Search for American Sign Language to English Dictionaries: Making the Most of Imperfect Sign RecognitionSaad Hassan, Akhter Al Amin, Alexis Gordon, Sooyeon Lee et al.CHI 2022 · 19 citations
- Open-Domain Sign Language Translation Learned from Online VideoBowen Shi, Diane Brentari, Gregory Shakhnarovich, Karen LivescuEMNLP 2022 · 39 citations
- Towards Sign Language-Centric Design of ASL Survey ToolsShruti Mahajan, Zoey Walker, Rachel Boll, Michelle Santacreu et al.CHI 2022 · 14 citations
- Assessment of Sign Language-Based versus Touch-Based Input for Deaf Users Interacting with Intelligent Personal AssistantsNina Tran, Paige S. DeVries, Matthew Seita, Raja S. Kushalnagar et al.CHI 2024 · 20 citations
- SignQuery: A Natural User Interface and Search Engine for Sign Languages with Wearable SensorsHao Zhou, Taiting Lu, Kristina Mckinnie, Joseph Palagano et al.MobiCom 2023 · 13 citations
