Sociotechnical Challenge Modeling: A Design Method for Responsible AI in Healthcare and Social Welfare

We present Sociotechnical Challenge Modeling (STCM), a workshop-based design method to help healthcare and social welfare practitioners identify and address sociotechnical challenges in machine learning (ML) deployments. We evaluated STCM in a field experiment with two UK organizations, involving 26 practitioners including managers, data scientists, and frontline care professionals. The evaluation found that STCM cultivated a sociotechnical perspective by revealing interdependencies between ML tools and organizational practices. The physical cards stimulated exchange and experimentation, while the workshop fostered collaboration across disciplines. However, participants found predefined countermeasures too prescriptive, which prompted revisions to support more open-ended ideation. Our contributions are a novel design method for anticipating and mitigating sociotechnical challenges of ML in care settings, and an empirical evaluation of its perceived value and limitations. To support adoption and further research, all STCM materials, including editable card templates and worksheets, are available at: https://bit.ly/4plXkfi.