"It's Complicated": Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and Disability
Cynthia L. Bennett, Cole Gleason, Morgan Klaus Scheuerman, Jeffrey P. Bigham, Anhong Guo, Alexandra To
Abstract
Content creators are instructed to write textual descriptions of visual content to make it accessible; yet existing guidelines lack specifics on how to write about people’s appearance, particularly while remaining mindful of consequences of (mis)representation. In this paper, we report on interviews with screen reader users who were also Black, Indigenous, People of Color, Non-binary, and/or Transgender on their current image description practices and preferences, and experiences negotiating theirs and others’ appearances non-visually. We discuss these perspectives, and the ethics of humans and AI describing appearance characteristics that may convey the race, gender, and disabilities of those photographed. In turn, we share considerations for more carefully describing appearance, and contexts in which such information is perceived salient. Finally, we offer tensions and questions for accessibility research to equitably consider politics and ecosystems in which technologies will embed, such as potential risks of human and AI biases amplifying through image descriptions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 34b43774-97d7-4fc4-a565-f7cf78433bb7Cited by top-tier papers25
- Understanding and Evaluating Racial Biases in Image CaptioningDora Zhao, Angelina Wang, Olga RussakovskyICCV 2021 · 165 citations
- Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic ContentAlan Lundgard, Arvind SatyanarayanIEEE VIS 2021 · 141 citations
- Social Justice in HCI: A Systematic Literature ReviewIshita Chordia, Leya Breanna Baltaxe-Admony, Ashley Boone, Alyssa Sheehan et al.CHI 2024 · 64 citations
- Hacking, Switching, Combining: Understanding and Supporting DIY Assistive Technology Design by Blind PeopleJaylin Herskovitz, Andi Xu, Rahaf Alharbi, Anhong GuoCHI 2023 · 53 citations
- Towards Inclusive Avatars: Disability Representation in Avatar PlatformsKelly Mack, Rai Ching Ling Hsu, Andrés Monroy-Hernández, Brian A. Smith et al.CHI 2023 · 52 citations
Builds on5
- Critical Race Theory for HCIIhudiya Finda Ogbonnaya-Ogburu, Angela D. R. Smith, Alexandra To, Kentaro ToyamaCHI 2020 · 397 citations
- How We've Taught Algorithms to See Identity: Constructing Race and Gender in Image Databases for Facial AnalysisMorgan Klaus Scheuerman, Kandrea Wade, Caitlin Lustig, Jed R. BrubakerCSCW 2020 · 198 citations
- "Person, Shoes, Tree. Is the Person Naked?" What People with Vision Impairments Want in Image DescriptionsAbigale Stangl, Meredith Ringel Morris, Danna GurariCHI 2020 · 136 citations
- Twitter A11y: A Browser Extension to Make Twitter Images AccessibleCole Gleason, Amy Pavel, Emma McCamey, Christina Low et al.CHI 2020 · 123 citations
- The Emerging Professional Practice of Remote Sighted Assistance for People with Visual ImpairmentsSooyeon Lee, Madison Reddie, Chun-Hua Tsai, Jordan Beck et al.CHI 2020 · 48 citations
Related papers
- From Provenance to Aberrations: Image Creator and Screen Reader User Perspectives on Alt Text for AI-Generated ImagesMaitraye Das, Alexander J. Fiannaca, Meredith Ringel Morris, Shaun K. Kane et al.CHI 2024 · 32 citations
- Accessibility of Profile Pictures: Alt Text and Beyond to Express Identity OnlineMartez E. Mott, John C. Tang, Edward CutrellCHI 2023 · 6 citations
- Communicating Visualizations without Visuals: Investigation of Visualization Alternative Text for People with Visual ImpairmentsCrescentia Jung, Shubham Mehta, Atharva Kulkarni, Yuhang Zhao et al.IEEE VIS 2021 · 2 citations
- "They only care to show us the wheelchair": disability representation in text-to-image AI modelsKelly Avery Mack, Rida Qadri, Remi Denton, Shaun K. Kane et al.CHI 2024 · 57 citations
- Inclusive Avatar Guidelines for People with Disabilities: Supporting Disability Representation in Social Virtual RealityKexin Zhang, Edward Glenn Scott Spencer, Abijith Manikandan, Andric Li et al.CHI 2025 · 22 citations
