Debugging Defective Visualizations: Empirical Insights Informing a Human-AI Co‑Debugging System
Shuyu Shen, Sirong Lu, Leixian Shen, Yuyu Luo
摘要
Visualization authoring is an iterative process requiring users to adjust parameters to achieve desired aesthetics. Due to its complexity, users often create defective visualizations and struggle to fix them. Many seek help on forums (e.g., Stack Overflow), while others turn to AI, yet little is known about the strengths and limitations of these approaches, or how they can be effectively combined. We analyze Vega-Lite debugging cases from Stack Overflow, categorizing question types by askers, evaluating human responses, and assessing AI performance. Guided by these findings, we design a human-AI co-debugging system that combines LLM-generated suggestions with forum knowledge. We evaluated this system in a user study on 36 unresolved problems, comparing it with forum answers and LLM baselines. Our results show that while forum contributors provide accurate but slow solutions and LLMs offer immediate but sometimes misaligned guidance, the hybrid system resolves 86% of cases, higher than either alone.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper28
- DS-1000: A Natural and Reliable Benchmark for Data Science Code GenerationYuhang Lai, Chengxi Li, Yiming Wang, Tianyi Zhang 等ICML 2023 · 被引用 504 次
- Is Stack Overflow Obsolete? An Empirical Study of the Characteristics of ChatGPT Answers to Stack Overflow QuestionsSamia Kabir, David N. Udo-Imeh, Bonan Kou, Tianyi ZhangCHI 2024 · 被引用 149 次
- Natural Language to Visualization by Neural Machine TranslationYuyu Luo, Nan Tang, Guoliang Li, Jiawei Tang 等IEEE VIS 2021 · 被引用 145 次
- Synthesizing Natural Language to Visualization (NL2VIS) Benchmarks from NL2SQL BenchmarksYuyu Luo, Nan Tang, Guoliang Li, Chengliang Chai 等SIGMOD 2021 · 被引用 90 次
- Towards Natural Language-Based Visualization AuthoringYun Wang, Zhitao Hou, Leixian Shen, Tongshuang Wu 等IEEE VIS 2022 · 被引用 74 次
相关 Paper
- VizLinter: A Linter and Fixer Framework for Data VisualizationQing Chen, Fuling Sun, Xinyue Xu, Zui Chen 等IEEE VIS 2021 · 被引用 60 次
- MisVisFix: An Interactive Dashboard for Detecting, Explaining, and Correcting Misleading Visualizations using Large Language ModelsAmit Kumar Das, Klaus MuellerIEEE VIS 2025 · 被引用 5 次
- ChatDBG: Augmenting Debugging with Large Language ModelsKyla Levin, Nicolas van Kempen, Emery D. Berger, Stephen N. FreundFSE 2025 · 被引用 3 次
- Natural Language Dataset Generation Framework for Visualizations Powered by Large Language ModelsHyung-Kwon Ko, Hyeon Jeon, Gwanmo Park, Dae Hyun Kim 等CHI 2024 · 被引用 20 次
- FeVisQA: Free-Form Question Answering over Data VisualizationsYuanfeng Song, Jinwei Lu, Yuanwei Song, Caleb Chen Cao 等ICDE 2025 · 被引用 2 次
