No Pixel Left Behind: Filling Gaps in Anime Colorization
Masahiro Kono, Akinobu Maejima, Yuki Koyama, Yotam Sechayk, Takeo Igarashi
Abstract
Animation production workflows often involve digital colorization of line art, where small unpainted regions (“gaps”) frequently occur and remain an underexplored challenge. We conducted a formative study in Japanese animation (anime) pipelines and found that while the paint bucket tool is widely used for base coloring, tiny enclosed areas are frequently overlooked, resulting in time-consuming manual detection and filling. We introduce GapFill, a tool grounded in professional practices that reduces the effort of gap detection, zooming, and color selection. Our deep-learning method suggests appropriate fill colors by referencing surrounding regions, leveraging the flat-color nature of anime-style images. In a user study with 13 professional colorists, our system improved performance and usability in gap-filling tasks over conventional methods. The study also suggested that prediction accuracy alone is not the primary factor for usability, that appropriate colors can be contextually ambiguous, and that GapFill can complement existing tools depending on users’ trust in new AI-powered assistance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a856487b-231b-4dae-ad0d-94c7039dc9e7Builds on11
- Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design ToolsFrederic Gmeiner, Humphrey Yang, Lining Yao, Kenneth Holstein et al.CHI 2023 · 125 citations
- FlatMagic: Improving Flat Colorization through AI-driven Design for Digital Comic ProfessionalsChuan Yan, John Joon Young Chung, Yoon Kiheon, Yotam I. Gingold et al.CHI 2022 · 50 citations
- How Time Pressure in Different Phases of Decision-Making Influences Human-AI CollaborationShiye Cao, Catalina Gómez Caballero, Chien-Ming HuangCSCW 2023 · 46 citations
- AniFaceDrawing: Anime Portrait Exploration during Your SketchingZhengyu Huang, Haoran Xie, Tsukasa Fukusato, Kazunori MiyataSIGGRAPH 2023 · 24 citations
- Griffith: A Storyboarding Tool Designed with Japanese Animation ProfessionalsJun Kato, Kenta Hara, Nao HirasawaCHI 2024 · 12 citations
Related papers
- Learning Inclusion Matching for Animation Paint Bucket ColorizationYuekun Dai, Shangchen Zhou, Qinyue Li, Chongyi Li et al.CVPR 2024
- User-Guided Line Art Flat Filling With Split Filling MechanismLvmin Zhang, Chengze Li, Edgar Simo-Serra, Yi Ji et al.CVPR 2021
- FlatGAN: A Holistic Approach for Robust Flat-Coloring in High-Definition with Understanding Line DiscontinuityHan Kim, Chunggi Lee, Junsoo Lee, Dohyun Kim et al.ACM MM 2023 · 1 citation
- A Unified Framework for Industrial Cel-Animation Colorization with Temporal-Structural AwarenessXiaoyi Feng, Tao Huang, Peng Wang, Zizhou Huang et al.ICCV 2025 · 3 citations
- ShadowMagic: Designing Human-AI Collaborative Support for Comic Professionals' ShadowingAmrita Ganguly, Chuan Yan, John Joon Young Chung, Tong Steven Sun et al.UIST 2024 · 8 citations
