Striking a Balance: Reader Takeaways and Preferences when Integrating Text and Charts
Chase Stokes, Vidya Setlur, Bridget Cogley, Arvind Satyanarayan, Marti A. Hearst
Abstract
While visualizations are an effective way to represent insights about information, they rarely stand alone. When designing a visualization, text is often added to provide additional context and guidance for the reader. However, there is little experimental evidence to guide designers as to what is the right amount of text to show within a chart, what its qualitative properties should be, and where it should be placed. Prior work also shows variation in personal preferences for charts versus textual representations. In this paper, we explore several research questions about the relative value of textual components of visualizations. 302 participants ranked univariate line charts containing varying amounts of text, ranging from no text (except for the axes) to a written paragraph with no visuals. Participants also described what information they could take away from line charts containing text with varying semantic content. We find that heavily annotated charts were not penalized. In fact, participants preferred the charts with the largest number of textual annotations over charts with fewer annotations or text alone. We also find effects of semantic content. For instance, the text that describes statistical or relational components of a chart leads to more takeaways referring to statistics or relational comparisons than text describing elemental or encoded components. Finally, we find different effects for the semantic levels based on the placement of the text on the chart; some kinds of information are best placed in the title, while others should be placed closer to the data. We compile these results into four chart design guidelines and discuss future implications for the combination of text and charts.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 16f2c52e-d7af-45a0-8509-593c9c1cc02eCited by top-tier papers31
- Graphologue: Exploring Large Language Model Responses with Interactive DiagramsPeiling Jiang, Jude Rayan, Steven P. Dow, Haijun XiaUIST 2023 · 135 citations
- UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and ReasoningAhmed Masry, Parsa Kavehzadeh, Do Xuan Long, Enamul Hoque et al.EMNLP 2023 · 48 citations
- VisText: A Benchmark for Semantically Rich Chart CaptioningBenny J. Tang, Angie W. Boggust, Arvind SatyanarayanACL 2023 · 44 citations
- Data Storytelling in Data Visualisation: Does it Enhance the Efficiency and Effectiveness of Information Retrieval and Insights Comprehension?Hongbo Shao, Roberto Martínez Maldonado, Vanessa Echeverría, Lixiang Yan et al.CHI 2024 · 43 citations
- Do You See What I See? A Qualitative Study Eliciting High-Level Visualization ComprehensionGhulam Jilani Quadri, Arran Zeyu Wang, Zhehao Wang, Jennifer Adorno Nieves et al.CHI 2024 · 37 citations
Builds on8
- Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic ContentAlan Lundgard, Arvind SatyanarayanIEEE VIS 2021 · 141 citations
- Answering Questions about Charts and Generating Visual ExplanationsDae Hyun Kim, Enamul Hoque, Maneesh AgrawalaCHI 2020 · 121 citations
- Kori: Interactive Synthesis of Text and Charts in Data DocumentsShahid Latif, Zheng Zhou, Yoon Kim, Fabian Beck et al.IEEE VIS 2021 · 69 citations
- Leveraging Text-Chart Links to Support Authoring of Data-Driven Articles with VizFlowNicole Sultanum, Fanny Chevalier, Zoya Bylinskii, Zhicheng LiuCHI 2021 · 64 citations
- Towards Understanding How Readers Integrate Charts and Captions: A Case Study with Line ChartsDae Hyun Kim, Vidya Setlur, Maneesh AgrawalaCHI 2021 · 52 citations
Related papers
- From Instruction to Insight: Exploring the Functional and Semantic Roles of Text in Interactive DashboardsNicole Sultanum, Vidya SetlurIEEE VIS 2024 · 9 citations
- Image or Information? Examining the Nature and Impact of Visualization Perceptual ClassificationAnjana Arunkumar, Lace M. K. Padilla, Gi-Yeul Bae, Chris BryanIEEE VIS 2023 · 15 citations
- An Analysis of Text Functions in Information VisualizationChase Stokes, Anjana Arunkumar, Marti A. Hearst, Lace M. K. PadillaIEEE VIS 2025 · 1 citation
- Lost in Translation: How Does Bilingualism Shape Reader Preferences for Annotated Charts?Anjana Arunkumar, Lace M. K. Padilla, Chris BryanCHI 2025 · 2 citations
- A Qualitative Analysis of Common Practices in Annotations: A Taxonomy and Design SpaceMd Dilshadur Rahman, Ghulam Jilani Quadri, Bhavana Doppalapudi, Danielle Albers Szafir et al.IEEE VIS 2024 · 21 citations
