Supporting Industry Computing Researchers in Assessing, Articulating, and Addressing the Potential Negative Societal Impact of Their Work
Wesley Hanwen Deng, Solon Barocas, Jennifer Wortman Vaughan
Abstract
Recent years have witnessed increasing calls for computing researchers to grapple with the societal impacts of their work. Tools such as impact assessments have gained prominence as a method to uncover potential impacts, and a number of publication venues now encourage authors to include an impact statement in their submissions. Despite this recent push, little is known about the way researchers go about assessing, articulating, and addressing the potential negative societal impact of their work --- especially in industry settings, where research outcomes are often quickly integrated into products and services. In addition, while there are nascent efforts to support researchers in this task, there remains a dearth of empirically-informed tools and processes. Through interviews with 25 industry computing researchers across different companies and research areas, we identify four key factors that influence how they grapple with (or choose not to grapple with) the societal impact of their research: the relationship between industry researchers and product teams; organizational dynamics and cultures that prioritize innovation and speed; misconceptions about societal impact; and a lack of sufficient infrastructure to support researchers. To develop an effective impact assessment template tailored to industry computing researchers' needs, we conduct an iterative co-design process with these 25 industry researchers, along with an additional 16 researchers and practitioners with prior experience and expertise in reviewing and developing impact assessments or responsible computing practices more broadly. Through the co-design process, we develop 10 design considerations to facilitate the effective design, implementation, and adaptation of an impact assessment template for use in industry research settings and beyond, as well as our own "Societal Impact Assessment" template with concrete scaffolds. We explore the effectiveness of this template through a user study with 15 industry research interns, revealing both its strengths and limitations. Finally, we discuss the implications for future researchers, organizations, and policymakers seeking to foster more responsible research practices.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AIWesley Hanwen Deng, Claire Wang, Howard Ziyu Han, Jason I. Hong et al.CSCW 2025 · 12 citations
- RiskRAG: A Data-Driven Solution for Improved AI Model Risk ReportingPooja S. B. Rao, Sanja Scepanovic, Ke Zhou, Edyta Paulina Bogucka et al.CHI 2025 · 7 citations
- Impact Assessment Card: Communicating Risks and Benefits of AI UsesEdyta Paulina Bogucka, Marios Constantinides, Sanja Scepanovic, Daniele QuerciaCSCW 2025 · 7 citations
- The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive PlatformGustavo Moreira, Edyta Paulina Bogucka, Marios Constantinides, Daniele QuerciaCHI 2025 · 5 citations
- "I Don't Think RAI Applies to My Model" - Engaging Non-champions with Sticky Stories for Responsible AI WorkNadia Nahar, Chenyang Yang, Yanxin Chen, Wesley Hanwen Deng et al.CHI 2026 · 2 citations
Builds on31
- Interpreting Interpretability: Understanding Data Scientists' Use of Interpretability Tools for Machine LearningHarmanpreet Kaur, Harsha Nori, Samuel Jenkins, Rich Caruana et al.CHI 2020 · 541 citations
- Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AIMichael A. Madaio, Luke Stark, Jennifer Wortman Vaughan, Hanna M. WallachCHI 2020 · 428 citations
- Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for Shifting Organizational PracticesBogdana Rakova, Jingying Yang, Henriette Cramer, Rumman ChowdhuryCSCW 2021 · 326 citations
- How do Data Science Workers Collaborate? Roles, Workflows, and ToolsAmy X. Zhang, Michael J. Muller, Dakuo WangCSCW 2020 · 260 citations
- Social Simulacra: Creating Populated Prototypes for Social Computing SystemsJoon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris et al.UIST 2022 · 192 citations
Related papers
- "That's important, but...": How Computer Science Researchers Anticipate Unintended Consequences of Their Research InnovationsKimberly Do, Rock Yuren Pang, Jiachen Jiang, Katharina ReineckeCHI 2023 · 40 citations
- A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness EvaluationsGlen Berman, Nitesh Goyal, Michael MadaioCHI 2024 · 40 citations
- The World is Not Enough: Growing Waste in HPC-enabled Academic PracticeCarolynne Lord, Adrian Friday, Adrian Jackson, Caroline Bird et al.CHI 2025 · 4 citations
- Responsible & Inclusive Cards: An Online Card Tool to Promote Critical Reflection in Technology Industry Work PracticesSalma Elsayed-Ali, Sara E. Berger, Vagner Figuerêdo de Santana, Juana Catalina Becerra SandovalCHI 2023 · 26 citations
- Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI ChallengesQiaosi Wang, Michael Madaio, Shaun K. Kane, Shivani Kapania et al.CHI 2023 · 90 citations
