Critical Design Strategy: A Method for Heuristically Evaluating Visualisation Designs
Jonathan C. Roberts, Hanan Alnjar, Aron E. Owen, Panagiotis D. Ritsos
Abstract
We present the Critical Design Strategy (CDS)-a structured method designed to facilitate the examination of visualisation designs through reflection and critical thought. The CDS helps designers think critically and make informed improvements using heuristic evaluation. When developing a visual tool or pioneering a novel visualisation approach, identifying areas for enhancement can be challenging. Critical thinking is particularly crucial for visualisation designers and tool developers, especially those new to the field, such as studying visualisation in higher education. The CDS consists of three stages across six perspectives: Stage 1 captures the essence of the idea by assigning an indicative title and selecting five adjectives (from twenty options) to form initial impressions of the design. Stage 2 involves an in-depth critique using 30 heuristic questions spanning six key perspectives-user, environment, interface, components, design, and visual marks. Stage 3 focuses on synthesising insights, reflecting on design decisions, and determining the next steps forward. We introduce the CDS and explore its use across three visualisation modules in both undergraduate and postgraduate courses. Our longstanding experience with the CDS has allowed us to refine and develop it over time: from its initial creation through workshops in 2017/18 to improvements in wording and the development of two applications by 2020, followed by the expansion of support notes and refinement of heuristics through 2023; while using it in our teaching each year. This sustained use allows us to reflect on its practical application and offer guidance on how others can incorporate it into their own work.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1b51422f-d3ad-4c40-b118-8fbf482a78d0Builds on2
- Composition and Configuration Patterns in Multiple-View VisualizationsXi Chen, Wei Zeng, Yanna Lin, Hayder Mahdi Al-Maneea et al.IEEE VIS 2020 · 138 citations
- Challenges and Opportunities in Data Visualization Education: A Call to ActionBenjamin Bach, Mandy Keck, Fateme Rajabiyazdi, Tatiana Losev et al.IEEE VIS 2023 · 58 citations
Related papers
- Beyond Problem Solving: Framing and Problem-Solution Co-Evolution in Data Visualization DesignPaul C. Parsons, Prakash Chandra ShuklaIEEE VIS 2025 · 5 citations
- Understanding how Designers Find and Use Data Visualization ExamplesHannah K. Bako, Xinyi Liu, Leilani Battle, Zhicheng LiuIEEE VIS 2022 · 37 citations
- A Heuristic Approach for Dual Expert/End-User Evaluation of Guidance in Visual AnalyticsDavide Ceneda, Christopher Collins, Mennatallah El-Assady, Silvia Miksch et al.IEEE VIS 2023 · 9 citations
- Troubling Collaboration: Matters of Care for Visualization Design StudyDerya Akbaba, Devin Lange, Michael Correll, Alexander Lex et al.CHI 2023 · 41 citations
- Introducing Layers of Meaning (LoM): A Framework to Reduce Semantic Distance of Visualization In Humanistic ResearchHouda Lamqaddam, Andrew Vande Moere, Vero Vanden Abeele, Koenraad Brosens et al.IEEE VIS 2020 · 19 citations
