Envisioning Narrative Intelligence: A Creative Visual Storytelling Anthology
Brett A. Halperin, Stephanie M. Lukin
Abstract
In this paper, we collect an anthology of 100 visual stories from authors who participated in our systematic creative process of improvised story-building based on image sequences. Following close reading and thematic analysis of our anthology, we present five themes that characterize the variations found in this creative visual storytelling process: ( 1) Narrating What is in Vision vs. Envisioning; (2) Dynamically Characterizing Entities/Objects; (3) Sensing Experiential Information About the Scenery; (4) Modulating the Mood; ( 5) Encoding Narrative Biases. In understanding the varied ways that people derive stories from images, we offer considerations for collecting story-driven training data to inform automatic story generation. In correspondence with each theme, we envision narrative intelligence criteria for computational visual storytelling as: creative, reliable, expressive, grounded, and responsible. From these criteria, we discuss how to foreground creative expression, account for biases, and operate in the bounds of visual storyworlds.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 080ba191-f8e0-419b-b955-577f8d2a45f4Cited by top-tier papers3
- Probing a Community-Based Conversational Storytelling Agent to Document Digital Stories of Housing InsecurityBrett A. Halperin, Gary Hsieh, Erin McElroy, James Pierce et al.CHI 2023 · 43 citations
- Metamorpheus: Interactive, Affective, and Creative Dream Narration Through Metaphorical Visual StorytellingQian Wan, Xin Feng, Yining Bei, Zhiqi Gao et al.CHI 2024 · 34 citations
- LLMs Behind the Scenes: Enabling Narrative Scene IllustrationMelissa Roemmele, John Joon Young Chung, Taewook Kim, Yuqian Sun et al.EMNLP 2025
Builds on8
- The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
- It Is Your Turn: Collaborative Ideation With a Co-Creative Robot through SketchYuyu Lin, Jiahao Guo, Yang Chen, Cheng Yao et al.CHI 2020 · 121 citations
- StoryDrawer: A Child-AI Collaborative Drawing System to Support Children's Creative Visual StorytellingChao Zhang, Cheng Yao, Jiayi Wu, Weijia Lin et al.CHI 2022 · 112 citations
- CLIP-Event: Connecting Text and Images with Event StructuresManling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou et al.CVPR 2022 · 103 citations
- Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data ScienceScott Allen Cambo, Darren GergleCHI 2022 · 49 citations
Related papers
- Methodological Reflections on Ways of SeeingHeekyoung Jung, Sookyung ChoCHI 2022 · 5 citations
- Imagine, Reason and Write: Visual Storytelling with Graph Knowledge and Relational ReasoningChunpu Xu, Min Yang, Chengming Li, Ying Shen et al.AAAI 2021 · 39 citations
- What Makes A Good Story? Designing Composite Rewards for Visual StorytellingJunjie Hu, Yu Cheng, Zhe Gan, Jingjing Liu et al.AAAI 2020 · 73 citations
- AESOP: Abstract Encoding of Stories, Objects, and PicturesHareesh Ravi, Kushal Kafle, Scott Cohen, Jonathan Brandt et al.ICCV 2021 · 19 citations
- Text-Only Training for Visual StorytellingYuechen Wang, Wengang Zhou, Zhenbo Lu, Houqiang LiACM MM 2023 · 4 citations
