TaleBrush: Sketching Stories with Generative Pretrained Language Models
John Joon Young Chung, Wooseok Kim, Kang Min Yoo, Hwaran Lee, Eytan Adar, Minsuk Chang
Abstract
While advanced text generation algorithms (e.g., GPT-3) have enabled writers to co-create stories with an AI, guiding the narrative remains a challenge. Existing systems often leverage simple turn-taking between the writer and the AI in story development. However, writers remain unsupported in intuitively understanding the AI's actions or steering the iterative generation. We introduce TaleBrush, a generative story ideation tool that uses line sketching interactions with a GPT-based language model for control and sensemaking of a protagonist's fortune in co-created stories. Our CHI '22, April 29-May 5, 2022, New Orleans, LA, USA Chung et al.
empirical evaluation found our pipeline reliably controls story generation while maintaining the novelty of generated sentences. In a user study with 14 participants with diverse writing experiences, we found participants successfully leveraged sketching to iteratively explore and write stories according to their intentions about the character's fortune while taking inspiration from generated stories. We conclude with a reflection on how sketching interactions can facilitate the iterative human-AI co-creation process.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f60b70f6-2fa4-4eae-8881-893a771c8a91Cited by top-tier papers94
- Co-Writing Screenplays and Theatre Scripts with Language Models: Evaluation by Industry ProfessionalsPiotr Mirowski, Kory W. Mathewson, Jaylen Pittman, Richard EvansCHI 2023 · 235 citations
- Understanding the Benefits and Challenges of Deploying Conversational AI Leveraging Large Language Models for Public Health InterventionEunkyung Jo, Daniel A. Epstein, Hyunhoon Jung, Young-Ho KimCHI 2023 · 167 citations
- A Design Space for Intelligent and Interactive Writing AssistantsMina Lee, Katy Ilonka Gero, John Joon Young Chung, Simon Buckingham Shum et al.CHI 2024 · 133 citations
- Social Dynamics of AI Support in Creative WritingKaty Ilonka Gero, Tao Long, Lydia B. ChiltonCHI 2023 · 125 citations
- How Knowledge Workers Think Generative AI Will (Not) Transform Their IndustriesAllison Woodruff, Renee Shelby, Patrick Gage Kelley, Steven Rousso-Schindler et al.CHI 2024 · 109 citations
Builds on22
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Plug and Play Language Models: A Simple Approach to Controlled Text GenerationSumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung et al.ICLR 2020 · 1,166 citations
- AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated PromptsTaylor Shin, Yasaman Razeghi, Robert L. Logan IV, Eric Wallace et al.EMNLP 2020 · 1,162 citations
- Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning ApproachAshish Sharma, Inna W. Lin, Adam S. Miner, David C. Atkins et al.WWW 2021 · 183 citations
- A Distributional Approach to Controlled Text GenerationMuhammad Khalifa, Hady Elsahar, Marc DymetmanICLR 2021 · 135 citations
Related papers
- SketchGPT: A Sketch-based Multimodal Interface for Application-Agnostic LLM InteractionZeyuan Huang, Cangjun Gao, Yaxian Shan, Haoxiang Hu et al.UIST 2025 · 8 citations
- Inkspire: Supporting Design Exploration with Generative AI through Analogical SketchingDavid Chuan-En Lin, Hyeonsu B. Kang, Nikolas Martelaro, Aniket Kittur et al.CHI 2025 · 56 citations
- Sci-Fi Spark: A Human-AI Co-Creation System for Science Fiction IdeationZhaojun Jiang, Wengteng Cheang, Xuanpei Xu, Haoyu Zuo et al.CHI 2026 · 1 citation
- Less Redraw, More Explore: Suggestion and Completion for Sketch-to-ImageZeyu Zhao, Connor Rees, Gavin Bailey, Matt Jones et al.CHI 2026 · 1 citation
- From Words to Wonder: Designing and Evaluating an AI-Empowered Creative Storytelling System for Elementary ChildrenMin Fan, Xinyue Cui, Wanqing Ma, Haiyan Li et al.CHI 2025 · 21 citations
