EllSeg: An Ellipse Segmentation Framework for Robust Gaze Tracking
Rakshit Sunil Kothari, Aayush K. Chaudhary, Reynold J. Bailey, Jeff B. Pelz, Gabriel J. Diaz
Abstract
Ellipse fitting, an essential component in pupil or iris tracking based video oculography, is performed on previously segmented eye parts generated using various computer vision techniques. Several factors, such as occlusions due to eyelid shape, camera position or eyelashes, frequently break ellipse fitting algorithms that rely on well-defined pupil or iris edge segments. In this work, we propose training a convolutional neural network to directly segment entire elliptical structures and demonstrate that such a framework is robust to occlusions and offers superior pupil and iris tracking performance (at least 10% and 24% increase in pupil and iris center detection rate respectively within a two-pixel error margin) compared to using standard eye parts segmentation for multiple publicly available synthetic segmentation datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Real-Time Gaze Tracking with Event-Driven Eye SegmentationYu Feng, Nathan Goulding-Hotta, Asif Khan, Hans Reyserhove et al.IEEE VR 2022 · 55 citations
- BlissCam: Boosting Eye Tracking Efficiency with Learned In-Sensor Sparse SamplingYu Feng, Tianrui Ma, Yuhao Zhu, Xuan ZhangISCA 2024 · 14 citations
- EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event SlicingArgha Sen, Nuwan Sriyantha Bandara, Ila Gokarn, Thivya Kandappu et al.UbiComp 2025 · 5 citations
- Seeing the World through Your EyesHadi Alzayer, Kevin Zhang, Brandon Y. Feng, Christopher A. Metzler et al.CVPR 2024
Related papers
- A Deep Learning Approach for the Segmentation of Electroencephalography Data in Eye Tracking ApplicationsLukas Wolf, Ard Kastrati, Martyna Beata Plomecka, Jie-Ming Li et al.ICML 2022 · 15 citations
- Dynamic Graph Representation for Occlusion Handling in BiometricsMin Ren, Yunlong Wang, Zhenan Sun, Tieniu TanAAAI 2020 · 28 citations
- Generalizing Hand Segmentation in Egocentric Videos With Uncertainty-Guided Model AdaptationMinjie Cai, Feng Lu, Yoichi SatoCVPR 2020
- Swift-Eye: Towards Anti-blink Pupil Tracking for Precise and Robust High-Frequency Near-Eye Movement Analysis with Event CamerasTongyu Zhang, Yiran Shen, Guangrong Zhao, Lin Wang et al.IEEE VR 2024 · 30 citations
- GazeGene: Large-scale Synthetic Gaze Dataset with 3D Eyeball AnnotationsYiwei Bao, Zhiming Wang, Feng LuCVPR 2025
