Investigating How Physical Surfaces Can Serve as Common-Region Cues for Perceptual Grouping of Virtual Elements in Augmented Reality

Perceptual grouping enables people to organize elements into units according to intrinsic (e.g., proximity) and extrinsic (e.g., common region) principles. However, the role of physical surfaces as extrinsic grouping cues for virtual elements in Augmented Reality (AR) remains unclear. To provide a deeper understanding, we conducted two within-subject studies. The first study (N = 24) using repetition discrimination tasks revealed that surfaces can be common-region cues in 3D, with their influence depending on their distance to target objects along the viewing direction. Building on these findings, the second study (N = 24) employed both objective and subjective measures to capture the interaction between proximity and common-region cues in AR. Results indicate that competing cues reduce group clarity. They also enable us to distill people’s strategies for improving the clarity by leveraging their physical and virtual environments. Finally, we propose design recommendations for future AR systems in assisted grouping tasks.