Exploring Interface Design of MR Translation System for Everyday Interaction

Mixed reality (MR) translation systems offer new opportunities for real-time multilingual communication by rendering translated text into users’ visual environments. However, how different interface designs impact their usability and user experience remains largely underexplored. This study presents a systematic exploration of MR translation interface designs through a Wizard-of-Oz experiment (N = 24). We compare three interface designs in both passive reading comprehension and active interaction tasks with a physical display. Our results revealed that interface design significantly affects perceived effectiveness of the system, user performance, and cognitive load. Based on these findings, we outline design recommendations and potential research directions for advancing MR translation systems in everyday use.