Gram-based Attentive Neural Ordinary Differential Equations Network for Video Nystagmography Classification
Xihe Qiu, Shaojie Shi, Xiaoyu Tan, Chao Qu, Zhijun Fang, Hailing Wang, Yongbin Gao, Peixia Wu, Huawei Li
Abstract
Video nystagmography (VNG) is the diagnostic gold standard of benign paroxysmal positional vertigo (BPPV), which requires medical professionals to examine the direction, frequency, intensity, duration, and variation in the strength of nystagmus on a VNG video. This is a tedious process heavily influenced by the doctor's experience, which is error-prone. Recent automatic VNG classification methods approach this problem from the perspective of video analysis without considering medical prior knowledge, resulting in unsatisfactory accuracy and limited diagnostic capability for nystagmographic types, thereby preventing their clinical application. In this paper, we propose an end-to-end data-driven novel BPPV diagnosis framework (TC-BPPV) by considering this problem as an eye trajectory classification problem due to the disease's symptoms and experts' prior knowledge. In this framework, we utilize an eye movement tracking system to capture the eye trajectory and propose the Gram-based attentive neural ordinary differential equations network (Gram-AODE) to perform classification. We validate our framework using the VNG dataset provided by the collaborative university hospital and achieve state-of-the-art performance. We also evaluate Gram-AODE on multiple open-source benchmarks to demonstrate its effectiveness in trajectory classification. Code is available at https://github.com/ XiheQiu/Gram-AODE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1fca8cb9-4d83-45e4-9d74-ed68a0efd4f3Cited by top-tier papers1
Ask how each one uses itBuilds on4
- TapNet: Multivariate Time Series Classification with Attentional Prototypical NetworkXuchao Zhang, Yifeng Gao, Jessica Lin, Chang-Tien LuAAAI 2020 · 363 citations
- ShapeNet: A Shapelet-Neural Network Approach for Multivariate Time Series ClassificationGuozhong Li, Byron Choi, Jianliang Xu, Sourav S. Bhowmick et al.AAAI 2021 · 177 citations
- LyaNet: A Lyapunov Framework for Training Neural ODEsIvan Dario Jimenez Rodriguez, Aaron D. Ames, Yisong YueICML 2022 · 78 citations
- How to Train Your Neural ODE: the World of Jacobian and Kinetic RegularizationChris Finlay, Jörn-Henrik Jacobsen, Levon Nurbekyan, Adam M. ObermanICML 2020 · 76 citations
Related papers
- Towards Consumer-Grade Cybersickness Prediction: Multi-Model Alignment for Real-Time Vision-Only InferenceYitong Zhu, Zhuowen Liang, Yiming Wu, Tangyao Li et al.ACM MM 2025 · 3 citations
- TULIP: Multi-Camera 3D Precision Assessment of Parkinson's DiseaseKyungdo Kim, Sihan Lyu, Sneha Mantri, Timothy W. DunnCVPR 2024
- Adaptive Spatio-Temporal Directed Graph Neural Network for Parkinson's Detection using Vertical Ground Reaction ForceXiaotian Wang, Shuo Liang, Zhifu Zhao, Xinyu Cui et al.ACM MM 2023 · 7 citations
- Investigating How Brain Stimulation Mitigates Motion Sickness Using Spatiotemporal Nystagmus Parameters Captured in VRGang Li, Mark McGill, Alana Grant, Katherina Poehlmann et al.IEEE VR 2026
- A Deep Learning Approach for the Segmentation of Electroencephalography Data in Eye Tracking ApplicationsLukas Wolf, Ard Kastrati, Martyna Beata Plomecka, Jie-Ming Li et al.ICML 2022 · 15 citations
