Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric Videos
Chiara Plizzari, Alessio Tonioni, Yongqin Xian, Achin Kulshrestha, Federico Tombari
Abstract
Our dataset: EgoTempo Free-form Video Q&A Temporal Event Ordering Q: What does the person do after draining the excess water? Object Counting Q: What is the sequence of actions the person performs with the mug? Multi-Modal LLMs Temporal Understanding Limitations of previous egocentric VideoQA datasets Single-frame Understanding Commonsense Reasoning Q: What is the main purpose of using aluminum foil? Q: What is the status of the microwave before the user gets something from it? Action Sequence Q: How many oranges does the person pick from the tree?
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c9842f08-db09-48ae-9815-66dd58f683fbCited by top-tier papers13
- Flattery in Motion: Benchmarking and Analyzing Sycophancy in Video-LLMsWenrui Zhou, Mohamed Hendy, Shu Yang, Qingsong Yang et al.ACL 2026 · 21 citations
- EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging BenchmarkDeheng Zhang, Yuqian Fu, Runyi Yang, Yang Miao et al.ICLR 2026 · 19 citations
- SAVVY: Spatial Awareness via Audio-Visual LLMs through Seeing and HearingMingfei Chen, Zijun Cui, Xiulong Liu, Jinlin Xiang et al.NeurIPS 2025 · 18 citations
- EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question AnsweringYanjun Li, Yuqian Fu, Tianwen Qian, Qi'ao Xu et al.AAAI 2026 · 14 citations
- CLiViS: Unleashing Cognitive Map through Linguistic-Visual Synergy for Embodied Visual ReasoningKailing Li, Qi'ao Xu, Tianwen Qian, Yuqian Fu et al.CVPR 2026 · 12 citations
Builds on18
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Flamingo: a Visual Language Model for Few-Shot LearningJean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech et al.NeurIPS 2022 · 6,707 citations
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationJunnan Li, Dongxu Li, Caiming Xiong, Steven C. H. HoiICML 2022 · 6,549 citations
- PaLM-E: An Embodied Multimodal Language ModelDanny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch et al.ICML 2023 · 2,601 citations
- Language Is Not All You Need: Aligning Perception with Language ModelsShaohan Huang, Li Dong, Wenhui Wang, Yaru Hao et al.NeurIPS 2023 · 810 citations
Related papers
- Ego-Grounding for Personalized Question-Answering in Egocentric VideosJunbin Xiao, Shenglang Zhang, Pengxiang Zhu, Angela YaoCVPR 2026 · 7 citations
- Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware ReasoningSARA GHAZANFARI, Francesco Croce, Nicolas Flammarion, Prashanth Krishnamurthy et al.CVPR 2026 · 35 citations
- TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation ModelsZiyao Shangguan, Chuhan Li, Yuxuan Ding, Yanan Zheng et al.ICLR 2025
- LLaVAction: evaluating and training multi-modal large language models for action understandingHaozhe Qi, Shaokai Ye, Alexander Mathis, Mackenzie W. MathisICLR 2026 · 3 citations
- OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?Junbo Niu, Yifei Li, Ziyang Miao, Chunjiang Ge et al.CVPR 2025
