Navigating Uncertainties: How GenAI Developers Document Their Models on Open-Source Platforms
Ningjing Tang, Megan Li, Amy A. Winecoff, Michael Madaio, Hoda Heidari, Hong Shen
Abstract
Model documentation plays a crucial role in promoting responsible AI (RAI) development. The emergence of Generative AI (GenAI) models has reshaped the conditions under which documentation is produced, particularly on open-source platforms where models are hosted and shared. To examine how these changes have manifested in developers' documentation practices, we interviewed 17 GenAI developers who document models on open-source platforms. Our findings illustrate that uncertainties have become a defining feature of developers' GenAI documentation practices and that these uncertainties unfold in three interrelated forms: (1) normative and epistemic uncertainties in determining documentation content; (2) methodological uncertainties in evaluating and communicating model properties; and (3) ecosystemic uncertainties about who should document. We argue that these uncertainties in GenAI documentation require coordinated interventions, including infrastructural support to address epistemic and methodological uncertainties, community-based mechanisms to cultivate RAI documentation norms, and collaboration across supply-chain actors to address ecosystemic uncertainties.
• Human-centered computing → Empirical studies in HCI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c5dbaca9-c32a-41c7-a240-ae4850108e12Cited by top-tier papers1
Ask how each one uses itBuilds on26
- How do Data Science Workers Collaborate? Roles, Workflows, and ToolsAmy X. Zhang, Michael J. Muller, Dakuo WangCSCW 2020 · 260 citations
- Between Subjectivity and Imposition: Power Dynamics in Data Annotation for Computer VisionMilagros Miceli, Martin Schuessler, Tianling YangCSCW 2020 · 148 citations
- Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User ExperienceQ. Vera Liao, Hariharan Subramonyam, Jennifer Wang, Jennifer Wortman VaughanCHI 2023 · 81 citations
- Designing Ground Truth and the Social Life of LabelsMichael J. Muller, Christine T. Wolf, Josh Andres, Michael Desmond et al.CHI 2021 · 80 citations
- Datasheets for Datasets help ML Engineers Notice and Understand Ethical Issues in Training DataKaren L. BoydCSCW 2021 · 68 citations
Related papers
- Emerging Data Practices: Data Work in the Era of Large Language ModelsAdriana Alvarado Garcia, Heloisa Candello, Karla Badillo-Urquiola, Marisol Wong-VillacresCHI 2025 · 6 citations
- "It is currently hodgepodge": Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI ValuesRama Adithya Varanasi, Nitesh GoyalCHI 2023 · 52 citations
- Responsible Prompting Recommendation: Fostering Responsible AI Practices in Prompting-TimeVagner Figueredo de Santana, Sara E. Berger, Heloisa Candello, Tiago Machado et al.CHI 2025 · 6 citations
- A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness EvaluationsGlen Berman, Nitesh Goyal, Michael MadaioCHI 2024 · 40 citations
- Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI ChallengesQiaosi Wang, Michael Madaio, Shaun K. Kane, Shivani Kapania et al.CHI 2023 · 90 citations
