Towards a Responsible AI Organizational Maturity Model
Amy Heger, Samir Passi, Shipi Dhanorkar, Zoe Kahn, Ruotong Wang, Mihaela Vorvoreanu
Abstract
MIHAELA VORVOREANU, Microsoft, USA Artificial intelligence (AI) holds tremendous potential but also poses consequential risks. Regulation frameworks like the EU AI Act aim to mitigate these risks, yet organizations struggle to understand and operationalize Responsible AI (RAI). We introduce the RAI Organizational Maturity (RAI-OM) framework as an initial step towards a RAI maturity model to highlight the many factors that influence an organization's RAI maturity. Developed through in-depth qualitative interviews and co-design sessions with 90 RAI experts, the RAI-OM framework consists of 24 dimensions grouped into three main categories: Organizational Foundations, Team Approach, and RAI Practices. Our findings also provide further evidence for the interdependent nature of RAI's organizational factors, the import of collaboration for mature RAI, and the need to start RAI early in the AI lifecyle. Researchers and practitioners can use the RAI-OM framework and our research findings to not only understand the different moving parts in RAI's complex organizational machinery, but also address organizational barriers to RAI, unpack the different types of collaborations needed for mature RAI, and support RAI's articulation work and process.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 325ead6a-0cc7-421b-9259-ddffa2ca03ffBuilds on22
- Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AIMichael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, Hanna M. WallachCHI 2020 · 428 citations
- Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for Shifting Organizational PracticesBogdana Rakova, Jingying Yang, Henriette Cramer, Rumman ChowdhuryCSCW 2021 · 326 citations
- Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for SupportMichael Madaio, Lisa Egede, Hariharan Subramonyam, Jennifer Wortman Vaughan et al.CSCW 2022 · 149 citations
- How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case StudyDavid Piorkowski, Soya Park, April Yi Wang, Dakuo Wang et al.CSCW 2021 · 142 citations
- Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and ProcessNadia Nahar, Shurui Zhou, Grace A. Lewis, Christian KästnerICSE 2022 · 122 citations
Related papers
- "The Conduit by which Change Happens": Processes, Barriers, and Support for Interpersonal Learning about Responsible AIJaemarie Solyst, Lauren Wilcox, Michael MadaioCHI 2025 · 4 citations
- Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI ChallengesQiaosi Wang, Michael Madaio, Shaun K. Kane, Shivani Kapania et al.CHI 2023 · 90 citations
- "It is currently hodgepodge": Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI ValuesRama Adithya Varanasi, Nitesh GoyalCHI 2023 · 52 citations
- "You Can either Blame Technology or Blame a Person..." - A Conceptual Model of Users' AI-Risk Perception as a Tool for HCILena Recki, Dennis Lawo, Veronika Krauß, Dominik Pins et al.CSCW 2024 · 6 citations
- A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness EvaluationsGlen Berman, Nitesh Goyal, Michael MadaioCHI 2024 · 40 citations
