Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services
Tzu-Sheng Kuo, Hong Shen, Jisoo Geum, Nev Jones, Jason I. Hong, Haiyi Zhu, Kenneth Holstein
Abstract
Recent years have seen growing adoption of AI-based decision-support systems (ADS) in homeless services, yet we know little about stakeholder desires and concerns surrounding their use. In this work, we aim to understand impacted stakeholders’ perspectives on a deployed ADS that prioritizes scarce housing resources. We employed AI lifecycle comicboarding, an adapted version of the comicboarding method, to elicit stakeholder feedback and design ideas across various components of an AI system’s design. We elicited feedback from county workers who operate the ADS daily, service providers whose work is directly impacted by the ADS, and unhoused individuals in the region. Our participants shared concerns and design suggestions around the AI system’s overall objective, specific model design choices, dataset selection, and use in deployment. Our findings demonstrate that stakeholders, even without AI knowledge, can provide specific and critical feedback on an AI system’s design and deployment, if empowered to do so.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers42
- Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for RadiologyNur Yildirim, Hannah Richardson, Maria Teodora Wetscherek, Junaid Bajwa et al.CHI 2024 · 81 citations
- Deepfakes, Phrenology, Surveillance, and More! A Taxonomy of AI Privacy RisksHao-Ping (Hank) Lee, Yu-Ju Yang, Thomas Serban Von Davier, Jodi Forlizzi et al.CHI 2024 · 73 citations
- The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder, Early-stage Deliberations Around Public Sector AI ProposalsAnna Kawakami, Amanda Coston, Haiyi Zhu, Hoda Heidari et al.CHI 2024 · 54 citations
- Understanding Contestability on the Margins: Implications for the Design of Algorithmic Decision-making in Public ServicesNaveena Karusala, Sohini Upadhyay, Rajesh Veeraraghavan, Krzysztof Z. GajosCHI 2024 · 33 citations
- Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care UnitNur Yildirim, Susanna Zlotnikov, Deniz Sayar, Jeremy M. Kahn et al.CHI 2024 · 32 citations
Builds on6
- Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision SupportAnna Kawakami, Venkatesh Sivaraman, Hao Fei Cheng, Logan Stapleton et al.CHI 2022 · 137 citations
- A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-WelfareDevansh Saxena, Karla A. Badillo-Urquiola, Pamela J. Wisniewski, Shion GuhaCSCW 2021 · 133 citations
- A Human-Centered Review of Algorithms used within the U.S. Child Welfare SystemDevansh Saxena, Karla A. Badillo-Urquiola, Pamela J. Wisniewski, Shion GuhaCHI 2020 · 114 citations
- ORES: Lowering Barriers with Participatory Machine Learning in WikipediaAaron Halfaker, R. Stuart GeigerCSCW 2020 · 84 citations
- Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment AlgorithmsSamantha Robertson, Tonya Nguyen, Niloufar SalehiCHI 2021 · 57 citations
Related papers
- Intermediation: Algorithmic Prioritization in Practice in Homeless ServicesPelle Tracey, Patricia GarciaCSCW 2024 · 5 citations
- The Datafication of Care in Public Homelessness ServicesErina Seh-Young Moon, Devansh Saxena, Dipto Das, Shion GuhaCHI 2025 · 6 citations
- Large Language Models in Peer-Run Community Behavioral Health Services: Understanding Peer Specialists and Service Users' Perspectives on Opportunities, Risks, and Mitigation StrategiesCindy Peng, Megan Chai, Gao Mo, Naveen Raman et al.CHI 2026 · 2 citations
- "Who is the right homeless client?": Values in Algorithmic Homelessness Service Provision and Machine Learning ResearchDilruba Showkat, Angela D. R. Smith, Lingqing Wang, Alexandra ToCHI 2023 · 18 citations
- Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and UseAnna Kawakami, Amanda Coston, Hoda Heidari, Kenneth Holstein et al.CSCW 2024 · 22 citations
