Assistive-Technology Aided Manual Accessibility Testing in Mobile Apps, Powered by Record-and-Replay
Navid Salehnamadi, Ziyao He, Sam Malek
Abstract
Billions of people use smartphones on a daily basis, including 15% of the world's population with disabilities. Mobile platforms encourage developers to manually assess their apps' accessibility in the way disabled users interact with phones, i.e., through Assistive Technologies (AT) like screen readers. However, most developers only test their apps with touch gestures and do not have enough knowledge to use AT properly. Moreover, automated accessibility testing tools typically do not consider AT. This paper introduces a record-and-replay technique that records the developers' touch interactions, replays the same actions with an AT, and generates a visualized report of various ways of interacting with the app using ATs. Empirical evaluation of this technique on real-world apps revealed that while user study is the most reliable way of assessing accessibility, our technique can aid developers in detecting complex accessibility issues at diferent stages of development.
• Software and its engineering → Software testing and debugging; • Human-centered computing → Accessibility design and evaluation methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 449a7c7f-7d20-4e84-987a-91b63af87ed6Cited by top-tier papers10
- AXNav: Replaying Accessibility Tests from Natural LanguageMaryam Taeb, Amanda Swearngin, Eldon Schoop, Ruijia Cheng et al.CHI 2024 · 51 citations
- CodeA11y: Making AI Coding Assistants Useful for Accessible Web DevelopmentPeya Mowar, Yi-Hao Peng, Jason Wu, Aaron Steinfeld et al.CHI 2025 · 22 citations
- Exploring Mobile Device Accessibility: Challenges, Insights, and Recommendations for Evaluation MethodologiesLetícia Seixas Pereira, Maria Matos, Carlos DuarteCHI 2024 · 18 citations
- Enhancing Web Accessibility: Automated Detection of Issues with Generative AIZiyao He, Syed Fatiul Huq, Sam MalekFSE 2025 · 10 citations
- "I tend to view ads almost like a pestilence": On the Accessibility Implications of Mobile Ads for Blind UsersZiyao He, Syed Fatiul Huq, Sam MalekICSE 2024 · 6 citations
Builds on6
- Unblind your apps: predicting natural-language labels for mobile GUI components by deep learningJieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu et al.ICSE 2020 · 101 citations
- Latte: Use-Case and Assistive-Service Driven Automated Accessibility Testing Framework for AndroidNavid Salehnamadi, Abdulaziz Alshayban, Jun-Wei Lin, Iftekhar Ahmed et al.CHI 2021 · 52 citations
- AccessiText: automated detection of text accessibility issues in Android appsAbdulaziz Alshayban, Sam MalekFSE 2022 · 28 citations
- Test Automation in Open-Source Android Apps: A Large-Scale Empirical StudyJun-Wei Lin, Navid Salehnamadi, Sam MalekASE 2020 · 27 citations
- Groundhog: An Automated Accessibility Crawler for Mobile AppsNavid Salehnamadi, Forough Mehralian, Sam MalekASE 2022 · 23 citations
Related papers
- Bridging the Gap between Automated Intervention and Actual User Experience: A Mixed-Methods Study on Mobile Accessibility Issues for Screen Reader UsersSyed Fatiul Huq, Ziyao He, Yirui He, Sam MalekCHI 2026 · 1 citation
- Automated Accessibility Analysis of Dynamic Content Changes on Mobile AppsForough Mehralian, Ziyao He, Sam MalekICSE 2025 · 2 citations
- Accessibility issues in Android apps: state of affairs, sentiments, and ways forwardAbdulaziz Alshayban, Iftekhar Ahmed, Sam MalekICSE 2020 · 130 citations
- Too Much Accessibility is Harmful! Automated Detection and Analysis of Overly Accessible Elements in Mobile AppsForough Mehralian, Navid Salehnamadi, Syed Fatiul Huq, Sam MalekASE 2022 · 19 citations
- Automatically Detecting Reflow Accessibility Issues in Responsive Web PagesPaul T. Chiou, Robert Winn, Ali S. Alotaibi, William G. J. HalfondICSE 2024 · 10 citations
