CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling
Sangho Suh, Jian Zhao, Edith Law
Abstract
Recent work demonstrated how we can design and use coding strips, a form of comic strips with corresponding code, to enhance teaching and learning in programming. However, creating coding strips is a creative, time-consuming process. Creators have to generate stories from code (code↦story) and design comics from stories (story↦comic). We contribute CodeToon, a comic authoring tool that facilitates this code-driven storytelling process with two mechanisms: (1) story ideation from code using metaphor and (2) automatic comic generation from the story. We conducted a two-part user study that evaluates the tool and the comics generated by participants to test whether CodeToon facilitates the authoring process and helps generate quality comics. Our results show that CodeToon helps users create accurate, informative, and useful coding strips in a significantly shorter time. Overall, this work contributes methods and design guidelines for code-driven storytelling and opens up opportunities for using art to support computer science education.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers11
- Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language ModelsSangho Suh, Bryan Min, Srishti Palani, Haijun XiaUIST 2023 · 147 citations
- Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-CreationSangho Suh, Meng Chen, Bryan Min, Toby Jia-Jun Li et al.CHI 2024 · 143 citations
- VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft PrototypingZheng Zhang, Jie Gao, Ranjodh Singh Dhaliwal, Toby Jia-Jun LiUIST 2023 · 101 citations
- ReelFramer: Human-AI Co-Creation for News-to-Video TranslationSitong Wang, Samia Menon, Tao Long, Keren Henderson et al.CHI 2024 · 47 citations
- Code Shaping: Iterative Code Editing with Free-form AI-Interpreted SketchingRyan Yen, Jian Zhao, Daniel VogelCHI 2025 · 32 citations
Builds on3
- Data Comics for Reporting Controlled User Studies in Human-Computer InteractionZezhong Wang, Jacob Ritchie, Jingtao Zhou, Fanny Chevalier et al.IEEE VIS 2020 · 44 citations
- ToonNote: Improving Communication in Computational Notebooks Using Interactive Data ComicsDaye Kang, Tony Ho, Nicolai Marquardt, Bilge Mutlu et al.CHI 2021 · 42 citations
- Interactive Data ComicsZezhong Wang, Hugo Romat, Fanny Chevalier, Nathalie Henry Riche et al.IEEE VIS 2021 · 41 citations
Related papers
- Composing Flexibly-Organized Step-by-Step Tutorials from Linked Source Code, Snippets, and OutputsAndrew Head, Jason Jiang, James Smith, Marti A. Hearst et al.CHI 2020 · 29 citations
- EmoG: Supporting the Sketching of Emotional Expressions for StoryboardingYang Shi, Nan Cao, Xiaojuan Ma, Siji Chen et al.CHI 2020 · 48 citations
- Colaroid: A Literate Programming Approach for Authoring Explorable Multi-Stage TutorialsApril Yi Wang, Andrew Head, Ashley Ge Zhang, Steve Oney et al.CHI 2023 · 11 citations
- DG Comics: Semi-Automatically Authoring Graph Comics for Dynamic GraphsJoohee Kim, Hyunwook Lee, Duc M. Nguyen, Minjeong Shin et al.IEEE VIS 2024 · 6 citations
- Taking ASCII Drawings Seriously: How Programmers Diagram CodeDevamardeep Hayatpur, Brian Hempel, Kathy Chen, William Duan et al.CHI 2024 · 7 citations
