Lune

CHI2026Top-tier venue

Criticmate: Stagewise Human-AI Co-Critique in Single-Screen UI Evaluation

Jisu Ko, Jinyoung Choi, Cielo Morales, Dajung Kim, Minsam Ko

2026Year
1Citations

Abstract

AI tools are increasingly used for UI evaluation, yet most treat evaluation as a single-pass, black-box process that limits both effective model reasoning and human involvement. Grounded in Situation Awareness (SA) theory, we reframe single-screen heuristic evaluation of mobile UIs as stagewise human–AI co-critique, structuring evaluation into three editable stages: Perception (what is on the screen), Comprehension (what elements mean and do), and Projection (what problems and fixes follow). We instantiate this framing in Criticmate, an interactive system that exposes intermediate reasoning artifacts for intervention. Across offline benchmarks and a controlled user study, we show that stagewise co-critique yields more expert-like and better balanced critiques than single-pass approaches, while supporting higher trust and engagement without reducing perceived autonomy.

Ask about this paper

Ask your agent about it.

Lune has read the top-tier papers around this one, so every answer names the papers it rests on.

Questions to start from

Your agent calls

Lunesearch_papers

Ask in Lune

Free to start. No credit card required.

lune papers get d3a6db53-27b7-451a-baa1-12e4eeb99f70

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines