Interaction Substrates: Combining Power and Simplicity in Interactive Systems
Wendy E. Mackay, Michel Beaudouin-Lafon
Abstract
Today's graphical user interfaces tend to be either simple but limited, or powerful but overly complex. In order to combine power and simplicity, we introduce Substrates, which act as "places for interaction" where users can manipulate objects of interest in a principled and predictable way. Substrates structure and contain data, enforce user-defned constraints among objects and manage dependencies with other substrates. Users can "tune" and "tweak" these relationships, "curry" specialized tools or abstract relationships into interactive templates. We frst defne substrates and provide in-depth descriptions with examples of their key characteristics. After explaining how Substrates extend the concept of Instrumental Interaction, we apply a Generative Theory of Interaction approach to analyze and critique existing interfaces and then show how using the concepts of Instruments and Substrates inspired novel design ideas in three graduate-level HCI courses. We conclude with a discussion and directions for future work.
• Human-centered computing → Human computer interaction (HCI).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b3a56faa-5b53-4e6f-9977-d36cadb1e02bCited by top-tier papers7
- DesignTrace: Exploring, Iterating and Tracking Design Alternatives with GenAIXiaohan Peng, Debanjana Haldar, Wendy E. Mackay, Janin KochCHI 2026 · 3 citations
- Convivial Fabrication: Towards Relational Computational Tools For and From Craft PracticesRitik Batra, Roy Zunder, Amy Cheatle, Amritansh Kwatra et al.CHI 2026 · 3 citations
- Interaction-Augmented Instruction: Modeling the Synergy of Prompts and Interactions in Human-GenAI CollaborationLeixian Shen, Yifang Wang, Huamin Qu, Xing Xie et al.CHI 2026 · 3 citations
- Managing Medication Plans When Information Is Scattered: Clinicians' Strategies and ToolsAnastasiya Zakreuskaya, Ignacio Avellino, Wendy E. MackayCHI 2026 · 1 citation
- Plotania: Exploring Transparency Trade-offs in AI Co-Writing Through Virtual Readers and Transparent AttributionYufeng Hu, Jinyi Zhang, Zehuan Wang, Chun YuCHI 2026 · 1 citation
Builds on6
- Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language ModelsSangho Suh, Bryan Min, Srishti Palani, Haijun XiaUIST 2023 · 147 citations
- Beyond the Artifact: Power as a Lens for Creativity Support ToolsJingyi Li, Eric Rawn, Jacob Ritchie, Jasper Tran O'Leary et al.UIST 2023 · 79 citations
- Exploring Technical Reasoning in Digital Tool UseMiguel A. Renom, Baptiste Caramiaux, Michel Beaudouin-LafonCHI 2022 · 67 citations
- Textlets: Supporting Constraints and Consistency in Text DocumentsHan L. Han, Miguel A. Renom, Wendy E. Mackay, Michel Beaudouin-LafonCHI 2020 · 35 citations
- StructGraphics: Flexible Visualization Design through Data-Agnostic and Reusable Graphical StructuresTheophanis TsandilasIEEE VIS 2020 · 26 citations
Related papers
- Interaction Methods in Generative AI Image Tools: A Review of Trends and Design Opportunities Across HCI and IndustryHyerim Park, Malin Eiband, André Luckow, Michael SedlmairCHI 2026 · 2 citations
- Interaction Knowledge: Understanding the 'Mechanics' of Digital ToolsMiguel A. Renom, Baptiste Caramiaux, Michel Beaudouin-LafonCHI 2023 · 10 citations
- Challenges of Music Score Writing and the Potentials of Interactive SurfacesVincent Cavez, Catherine Letondal, Emmanuel Pietriga, Caroline AppertCHI 2024 · 5 citations
- Dancing With Chains: Ideating Under Constraints With UIDEC in UI/UX DesignAtefeh Shokrizadeh, Boniface Bahati Tadjuidje, Shivam Kumar, Sohan Kamble et al.CHI 2025 · 6 citations
- Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data ModelYining Cao, Peiling Jiang, Haijun XiaCHI 2025 · 31 citations
