Interaction Methods in Generative AI Image Tools: A Review of Trends and Design Opportunities Across HCI and Industry
Hyerim Park, Malin Eiband, André Luckow, Michael Sedlmair
Abstract
Generative AI (GenAI) image tools are increasingly integrated into design workflows, prompting HCI research on their interaction methods and interfaces. We reviewed 37 such tools, including 28 HCI research systems and nine commercial systems (2022–July 2025), using three analytical frameworks: interaction methods, creative processes, and tool functionalities. We found that text prompts remain the dominant input method, while visual and attribute-based inputs—particularly in academic tools—are gaining traction and are often combined with text for refinement. Commercial systems emphasize parameter control, whereas academic tools focus on semantic attributes and visual organization. Most tools support ideation and exploration, but provide limited support for refinement and evaluation. Based on these findings, we identify nine design opportunities, including advanced visual interaction, simplified parameter control, precision editing, direct manipulation, workflow integration, default settings that support rapid exploration, and user guidance for later stages. We contribute a framework for analyzing GenAI interfaces and actionable directions for designing more usable, creativity-supportive GenAI image systems.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get e323a63b-1342-4444-8662-c9571802bcabRelated papers
- Interaction-Augmented Instruction: Modeling the Synergy of Prompts and Interactions in Human-GenAI CollaborationLeixian Shen, Yifang Wang, Huamin Qu, Xing Xie et al.CHI 2026 · 3 citations
- When Designers Sweat: Behavioral Traces of GenAI Co-CreationElena Cavallin, Simone SpagnolCHI 2026 · 2 citations
- The Impact of Sketch-guided vs. Prompt-guided 3D Generative AIs on the Design Exploration ProcessSeung Won Lee, Tae Hee Jo, Semin Jin, Jiin Choi et al.CHI 2024 · 48 citations
- DesignWeaver: Dimensional Scaffolding for Text-to-Image Product DesignSirui Tao, Ivan Liang, Cindy Peng, Zhiqing Wang et al.CHI 2025 · 19 citations
- FusAIn: Composing Generative AI Visual Prompts Using Pen-based InteractionXiaohan Peng, Janin Koch, Wendy E. MackayCHI 2025 · 15 citations
