SketchAgent: Language-Driven Sequential Sketch Generation
Yael Vinker, Tamar Rott Shaham, Kristine Zheng, Alex Zhao, Judith E. Fan, Antonio Torralba
2025Year
13Top-tier citations
Abstract
Buttefly" "Taj Mahal" "Neural Network" "Circuit Diagram" Figure 1 . SketchAgent leverages an off-the-shelf multimodal LLM to facilitate language-driven, sequential sketch generation through an intuitive sketching language. It can sketch diverse concepts, engage in interactive sketching with humans, and edit content via chat.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1a8cd109-71b1-4a36-b71f-beea45b66213Cited by top-tier papers13
- OASIS: On-Demand Hierarchical Event Memory for Streaming Video ReasoningZhijia Liang, Jiaming Li, Weikai Chen, Yanhao Zhang et al.CVPR 2026 · 16 citations
- NeuralSVG: An Implicit Representation for Text-to-Vector GenerationSagi Polaczek, Yuval Alaluf, Elad Richardson, Yael Vinker et al.ICCV 2025 · 6 citations
- Multi-Object Sketch Animation with Grouping and Motion Trajectory PriorsGuotao Liang, Juncheng Hu, Ximing Xing, Jing Zhang et al.ACM MM 2025 · 4 citations
- Instance Segmentation of Scene Sketches Using Natural Image PriorsMia Tang, Yael Vinker, Chuan Yan, Lvmin Zhang et al.SIGGRAPH 2025 · 3 citations
- BannerAgency: Advertising Banner Design with Multimodal LLM AgentsHeng Wang, Yotaro Shimose, Shingo TakamatsuEMNLP 2025 · 2 citations
Builds on35
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
Related papers
- SketchGPT: A Sketch-based Multimodal Interface for Application-Agnostic LLM InteractionZeyuan Huang, Cangjun Gao, Yaxian Shan, Haoxiang Hu et al.UIST 2025 · 8 citations
- Co-Ideation Across Time: Revitalizing Legacy Design Sketchnotes with Conversational AI Agents to Foster Intergenerational CollaborationYuqing Lucy Li, Quincy Kuang, Xiao Xiao, Jean-Baptiste Labrune et al.CHI 2026 · 2 citations
- ChatPattern: Layout Pattern Customization via Natural LanguageZixiao Wang, Yunheng Shen, Xufeng Yao, Wenqian Zhao et al.DAC 2024 · 9 citations
- LayerCraft: Enhancing Text-to-Image Generation with CoT Reasoning and Layered Object IntegrationYuyao Zhang, Jinghao Li, Yu-Wing TaiNeurIPS 2025 · 21 citations
- Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram GenerationZhiqing Cui, Jiahao Yuan, Hanqing Wang, Yanshu Li et al.ACM MM 2025 · 3 citations
