Interaction Knowledge: Understanding the 'Mechanics' of Digital Tools
Miguel A. Renom, Baptiste Caramiaux, Michel Beaudouin-Lafon
Abstract
User interfaces typically feature tools to act on objects and rely on the ability of users to discover or learn how to interact with them. Previous work in HCI has used the Theory of Affordances to explain how users understand the possibilities for action in digital environments. A complementary theory from cognitive neuroscience, Technical Reasoning, posits that users accumulate abstract knowledge of object properties and technical principles known as mechanical knowledge, essential in tool use. Drawing from this theory, we introduce interaction knowledge as the “mechanical” knowledge of digital environments. We provide evidence of its relevance by reporting on an experiment where participants performed tasks in a digital environment with ambiguous possibilities for interaction. We analyze how interaction knowledge was transferred across two digital domains, text editing and graphical editing, and conclude that interaction knowledge models an essential type of knowledge for interacting in the digital world.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- Textoshop: Interactions Inspired by Drawing Software to Facilitate Text EditingDamien Masson, Young-Ho Kim, Fanny ChevalierCHI 2025 · 38 citations
- Interaction Substrates: Combining Power and Simplicity in Interactive SystemsWendy E. Mackay, Michel Beaudouin-LafonCHI 2025 · 24 citations
- Interrogating AI: Characterizing Emergent Playful Interactions with ChatGPTMohammad Ronagh Nikghalb, Jinghui ChengCSCW 2025 · 12 citations
- 3D-Layers: Bringing Layer-Based Color Editing to VR PaintingEmilie Yu, Fanny Chevalier, Karan Singh, Adrien BousseauSIGGRAPH 2024 · 11 citations
- Texterial: A Text-as-Material Interaction Paradigm for LLM-Mediated WritingJocelyn J. Shen, Nicolai Marquardt, Hugo Romat, Ken Hinckley et al.CHI 2026 · 1 citation
Builds on1
Related papers
- Rediscovering Affordance: A Reinforcement Learning PerspectiveYi-Chi Liao, Kashyap Todi, Aditya Acharya, Antti Keurulainen et al.CHI 2022 · 22 citations
- Technical Mentality: Principles for HCI Research and PracticeGabrielle Benabdallah, Nadya PeekCHI 2024 · 6 citations
- Computational Rationality as a Theory of InteractionAntti Oulasvirta, Jussi P. P. Jokinen, Andrew HowesCHI 2022 · 127 citations
- AI Knowledge: Improving AI Delegation through Human EnablementMarc Pinski, Martin Adam, Alexander BenlianCHI 2023 · 58 citations
- Entangling Entanglement: A Diffractive Dialogue on HCI and Musical InteractionsLandon Morrison, Andrew P. McPhersonCHI 2024 · 25 citations
