Are You Open? A Content Analysis of Transparency and Openness Guidelines in HCI Journals
Nick Ballou, Vivek R. Warriar, Sebastian Deterding
Abstract
Within the wider open science reform movement, HCI researchers are actively debating how to foster transparency in their own field. Publication venues play a crucial role in instituting open science practices, especially journals, whose procedures arguably lend themselves better to them than conferences. Yet we know little about how much HCI journals presently support open science practices. We identified the 51 most frequently published-in journals by recent CHI first authors and coded them according to the Transparency and Openness Promotion guidelines, a high-profile standard of evaluating editorial practices. Results indicate that journals in our sample currently do not set or specify clear openness and transparency standards. Out of a maximum of 29, the modal score was 0 (mean = 2.5, SD = 3.6, max = 15). We discuss potential reasons, the aptness of natural science-based guidelines for HCI, and next steps for the HCI community in furthering openness and transparency.
• Human-centered computing → HCI theory, concepts and models; Empirical studies in HCI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ce352f5b-efa7-4261-9c4b-6659445e8469Cited by top-tier papers10
- Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022Kavous Salehzadeh Niksirat, Lahari Goswami, Pooja Rao S. B., James Tyler et al.CHI 2023 · 43 citations
- Understanding fraudulence in online qualitative studies: From the researcher's perspectiveAswati Panicker, Novia Nurain, Zaidat Ibrahim, Chun-Han Ariel Wang et al.CHI 2024 · 26 citations
- Small, Medium, Large? A Meta-Study of Effect Sizes at CHI to Aid Interpretation of Effect Sizes and Power CalculationAnna-Marie Ortloff, Florin Martius, Mischa Meier, Theo Raimbault et al.CHI 2025 · 17 citations
- Apéritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods DescriptionsYuren Pang, Katharina Reinecke, René JustCHI 2022 · 9 citations
- Replication and Extension of Video Game Demand Scale with a Turkish-Speaking Gamer PopulationMehmet Kosa, Nicholas David BowmanCHI 2023 · 6 citations
Builds on4
- Transparency of CHI Research Artifacts: Results of a Self-Reported SurveyChat Wacharamanotham, Lukas Eisenring, Steve Haroz, Florian EchtlerCHI 2020 · 120 citations
- Paths Explored, Paths Omitted, Paths Obscured: Decision Points & Selective Reporting in End-to-End Data AnalysisYang Liu, Tim Althoff, Jeffrey HeerCHI 2020 · 40 citations
- Code replicability in computer graphicsNicolas Bonneel, David Coeurjolly, Julie Digne, Nicolas MelladoSIGGRAPH 2020 · 21 citations
- OScH in the Wild: Dissemination of Open Science Hardware and Implications for HCIPiyum Fernando, Stacey KuznetsovCHI 2020 · 6 citations
Related papers
- On the Computational Reproducibility of Human-Computer InteractionOlga Iarygina, Kasper Hornbæk, Aske MottelsonCHI 2026 · 1 citation
- Towards Better Reflexive Thematic Analysis in HCI: A Scoping Review of Practice at CHIJacob M. Rigby, Ioanna IacovidesCHI 2026 · 6 citations
- Exploring Positionality in HCI: Perspectives, Trends, and ChallengesAneesha Singh, Martin Johannes Dechant, Dilisha Patel, Ewan Soubutts et al.CHI 2025 · 42 citations
- Reporting and Reviewing LLM-Integrated Systems in HCI: Challenges and ConsiderationsKarla Felix Navarro, Eugene Syriani, Ian ArawjoCHI 2026 · 1 citation
- How Transparent is Usable Privacy and Security Research? A Meta-Study on Current Research Transparency PracticesJan H. Klemmer, Juliane Schmüser, Fabian Fischer, Jacques Suray et al.USENIX Security 2025
