The Image of the Interface: How People Use Landmarks to Develop Spatial Memory of Commands in Graphical Interfaces
Md. Sami Uddin, Carl Gutwin
Abstract
Graphical User Interfaces present commands at particular locations, arranged in menus, toolbars, and ribbons. One hallmark of expertise with a GUI is that experts know the locations of commonly-used commands, such that they can find them quickly and without searching. Although GUIs have been studied for many years, however, there is still little known about how this spatial location memory develops, or how designers can make interfaces more memorable. One of the main ways that people remember locations in the real world is landmarks – so we carried out a study to investigate how users remember commands and navigate in four common applications (Word, Facebook, Reader, and Photoshop). Our study revealed that people strongly rely on landmarks that are readily available in the interface (e.g., layout, corners, and edges) to orient themselves and remember commands. We provide new evidence that landmarks can aid spatial memory and expertise development with an interface, and guidelines for designers to improve the memorability of future GUIs.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get b433caf3-97ef-40be-abd1-575fc819661bCited by top-tier papers1
Ask how each one uses itRelated papers
- Graph4GUI: Graph Neural Networks for Representing Graphical User InterfacesYue Jiang, Changkong Zhou, Vikas Garg, Antti OulasvirtaCHI 2024 · 17 citations
- GUI Exploration Lab: Enhancing Screen Navigation in Agents via Multi-Turn Reinforcement LearningHaolong Yan, Yeqing Shen, Xin Huang, Jia Wang et al.NeurIPS 2025 · 5 citations
- Understanding the Interplay of Cue Design, User Characteristics, and Environment on Gaze and Navigation in Mixed RealityYu Zhao, Jeanine K. Stefanucci, Sarah H. Creem-Regehr, Bobby BodenheimerIEEE VR 2026
- MP-GUI: Modality Perception with MLLMs for GUI UnderstandingZiwei Wang, Weizhi Chen, Leyang Yang, Sheng Zhou et al.CVPR 2025
- GUIGAN: Learning to Generate GUI Designs Using Generative Adversarial NetworksTianming Zhao, Chunyang Chen, Yuanning Liu, Xiaodong ZhuICSE 2021 · 58 citations
