Less Redraw, More Explore: Suggestion and Completion for Sketch-to-Image
Zeyu Zhao, Connor Rees, Gavin Bailey, Matt Jones, Simon Robinson, Jennifer Pearson
Abstract
Sketch-to-image systems let users transform simple line drawings into realistic images, but current workflows force users into tedious redraw-regenerate cycles that slow creative exploration. We introduce two complementary interaction techniques that reduce iteration friction: AutoSketch, which extends partial sketches through AI-driven completions (pre-generation support), and BackSketch, which transforms generated images back into editable sketches at multiple abstraction levels (post-generation support). In a study with 30 participants, the results indicate that both techniques can improve exploration and expressiveness compared to a baseline sketch-to-image system, while AutoSketch also can increase users’ sense of agency and co-creation with the AI. We contribute new evidence that shifting support before or after generation opens distinct pathways for balancing user control and system initiative. Together, our results establish pre- and post-generation assistance as a design space for co-creative sketch-to-image systems.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- Inkspire: Supporting Design Exploration with Generative AI through Analogical SketchingDavid Chuan-En Lin, Hyeonsu B. Kang, Nikolas Martelaro, Aniket Kittur et al.CHI 2025 · 56 citations
- Sketching vs. AI Prompt Based Design Intent Evolution in Undergraduate Students: an Exploratory StudyVanessa Sattele, Juan Carlos OrtizCHI 2026 · 1 citation
- SketchFlex: Facilitating Spatial-Semantic Coherence in Text-to-Image Generation with Region-Based SketchesHaichuan Lin, Yilin Ye, Jiazhi Xia, Wei ZengCHI 2025 · 25 citations
- Block and Detail: Scaffolding Sketch-to-Image GenerationVishnu Sarukkai, Lu Yuan, Mia Tang, Maneesh Agrawala et al.UIST 2024 · 23 citations
- Interaction Methods in Generative AI Image Tools: A Review of Trends and Design Opportunities Across HCI and IndustryHyerim Park, Malin Eiband, André Luckow, Michael SedlmairCHI 2026 · 2 citations
