SocialEyes: Scaling Mobile Eye-tracking to Multi-person Social Settings
Shreshth Saxena, Areez Visram, Neil Lobo, Zahid Mirza, Mehak Rafi Khan, Biranugan Pirabaharan, Alexander Nguyen, Lauren K. Fink
Abstract
Eye movements provide a window into human behaviour, attention, and interaction dynamics. Challenges in real-world, multi-person environments have, however, restrained eye-tracking research predominantly to single-person, in-lab settings. We developed a system to stream, record, and analyse synchronised data from multiple mobile eye-tracking devices during collective viewing experiences (e.g., concerts, films, lectures). We implemented lightweight operator interfaces for real-time-monitoring, remote-troubleshooting, and gaze-projection from individual egocentric perspectives to a common coordinate space for shared gaze analysis. We tested the system in a live concert and a film screening with 30 simultaneous viewers during each of two public events (N=60). We observe precise time-synchronisation between devices measured through recorded clock-offsets, and accurate gaze-projection in challenging dynamic scenes. Our novel analysis metrics and visualizations illustrate the potential of collective eye-tracking data for understanding collaborative behaviour and social interaction. This advancement promotes ecological validity in eye-tracking research and paves the way for innovative interactive tools.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 55c8080e-f889-4c76-9498-a5b11dfe13daBuilds on5
- InfraredTags: Embedding Invisible AR Markers and Barcodes Using Low-Cost, Infrared-Based 3D Printing and Imaging ToolsMustafa Doga Dogan, Ahmad Taka, Michael Lu, Yunyi Zhu et al.CHI 2022 · 59 citations
- Multimodal Gaze Interaction for Creative DesignChris Creed, Maite Frutos-Pascual, Ian WilliamsCHI 2020 · 33 citations
- GlanceWriter: Writing Text by Glancing Over Letters with GazeWenzhe Cui, Rui Liu, Zhi Li, Yifan Wang et al.CHI 2023 · 28 citations
- StageAR: Markerless Mobile Phone Localization for AR in Live EventsTao Jin, Shengxi Wu, Mallesham Dasari, Kittipat Apicharttrisorn et al.IEEE VR 2024 · 6 citations
- SuperGlue: Learning Feature Matching With Graph Neural NetworksPaul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, Andrew RabinovichCVPR 2020
Related papers
- Gaze Analysis System for Immersive 360° Video for Preservice Teacher EducationChris Lenart, Pegah Ahadian, Yuxin Yang, Simon Suo et al.ACM MM 2023 · 6 citations
- Foveated Encoding for Large High-Resolution DisplaysFlorian Frieß, Matthias Braun, Valentin Bruder, Steffen Frey et al.IEEE VIS 2020 · 19 citations
- GazeConduits: Calibration-Free Cross-Device Collaboration through Gaze and TouchSimon Voelker, Sebastian Hueber, Christian Holz, Christian Remy et al.CHI 2020 · 20 citations
- vGaze: Implicit Saliency-Aware Calibration for Continuous Gaze Tracking on Mobile DevicesSongzhou Yang, Yuan He, Meng JinINFOCOM 2021 · 11 citations
- Speech-Augmented Cone-of-Vision for Exploratory Data AnalysisRiccardo Bovo, Daniele Giunchi, Ludwig Sidenmark, Joshua Newn et al.CHI 2023 · 12 citations
