GazeOnce360: Fisheye-Based 360° Multi-Person Gaze Estimation with Global–Local Feature Fusion
Zhuojiang Cai, Zhenghui Sun, Feng Lu
Abstract
We present GazeOnce360, a novel end-to-end model for multi-person gaze estimation from a single tabletop-mounted upward-facing fisheye camera. Unlike conventional approaches that rely on forward-facing cameras in constrained viewpoints, we address the underexplored setting of estimating the 3D gaze direction of multiple people distributed across a 360° scene from an upward fisheye perspective. To support research in this setting, we introduce MPSGaze360, a large-scale synthetic dataset rendered using Unreal Engine, featuring diverse multi-person configurations with accurate 3D gaze and eye landmark annotations.Our model tackles the severe distortion and perspective variation inherent in fisheye imagery by incorporating rotational convolutions and eye landmark supervision. To better capture fine-grained eye features crucial for gaze estimation, we propose a dual-resolution architecture that fuses global low-resolution context with high-resolution local eye regions. Experimental results demonstrate the effectiveness of each component in our model. This work highlights the feasibility and potential of fisheye-based 360° gaze estimation in practical multi-person scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7fe3e100-2236-4504-b2a4-fd2c5273caf2Builds on6
- Gaze360: Physically Unconstrained Gaze Estimation in the WildPetr Kellnhofer, Adrià Recasens, Simon Stent, Wojciech Matusik et al.ICCV 2019 · 469 citations
- A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze EstimationYihua Cheng, Shiyao Huang, Fei Wang, Chen Qian et al.AAAI 2020 · 204 citations
- GazeOnce: Real-Time Multi-Person Gaze EstimationMingfang Zhang, Yunfei Liu, Feng LuCVPR 2022 · 30 citations
- Exploring 3D Interaction with Gaze Guidance in Augmented RealityYiwei Bao, Jiaxi Wang, Zhimin Wang, Feng LuIEEE VR 2023 · 26 citations
- From Feature to Gaze: A Generalizable Replacement of Linear Layer for Gaze EstimationYiwei Bao, Feng LuCVPR 2024
Related papers
- xR-EgoPose: Egocentric 3D Human Pose From an HMD CameraDenis Tomè, Patrick Peluse, Lourdes Agapito, Hernán BadinoICCV 2019 · 140 citations
- Estimating Egocentric 3D Human Pose in the Wild with External Weak SupervisionJian Wang, Lingjie Liu, Weipeng Xu, Kripasindhu Sarkar et al.CVPR 2022 · 33 citations
- Dynamic 3D Gaze from Afar: Deep Gaze Estimation from Temporal Eye-Head-Body CoordinationSoma Nonaka, Shohei Nobuhara, Ko NishinoCVPR 2022 · 31 citations
- Estimating Egocentric 3D Human Pose in Global SpaceJian Wang, Lingjie Liu, Weipeng Xu, Kripasindhu Sarkar et al.ICCV 2021 · 78 citations
- Large-Scale Person Detection and Localization using Overhead Fisheye CamerasLu Yang, Liulei Li, Xueshi Xin, Yifan Sun et al.ICCV 2023 · 35 citations
