Viago: Exploring Visual-Audio Modality Transitions for Social Media Consumption on the Go

Figure 1: Viago supports visual-audio modality transitions for mobile users on the go. In a scenario where a user is waiting for an order and browsing a mobile app: (a) The user initiates Viago by tapping the orange button, which provides a visual and audio preview, preparing the user for audio interactions on the go. (b) By vaguely recalling the layout of the interface and the available audio elements, the user can navigate the screen with touch gestures and audio feedback while heading to pick up the order. The important action (e.g., submit) will be cached for further visual confirmation before issuing. (c) Upon returning to the seat and resuming visual use, Viago provides visual and audio review to refresh the user's memory about content they heard and actions they did, and automatically restores cached actions, allowing the user to complete them visually.