Lune

NeurIPS2025Top-tier venue

VidEmo: Affective-Tree Reasoning for Emotion-Centric Video Foundation Models

Zhicheng Zhang, Weicheng Wang, Yongjie Zhu, Wenyu Qin, Pengfei Wan, Di Zhang, Jufeng Yang

Abstract

Four young girls are sitting on the floor in front of a gray sofa with multiple patterned cushions, all gazing forward, seemingly at a screen. The girl on the left has brown, wavy, long hair, big almond-shaped brown eyes, thick brown eyebrows, a small nose with a high bridge, and thick pink lips. She is wearing a gray long-sleeved shirt and bright pink pants. Initially, her mouth is closed, but around mid of the video, she opens her mouth in a slight gasp. The girl in the center has brown, curly, long hair, big almond-shaped brown eyes, thick brown eyebrows, a small nose with a high bridge, and thick pink lips. She wears a light pink tank top and gray pants and has bracelets on both her wrists. She sits with her arms clasped around her knees. She is pleased with TV show, that is indicated by her smile. The girl to the immediate right has blonde, straight, long hair, big almond-shaped blue eyes, narrow blonde eyebrows, a small nose with a high bridge, and thick pink lips. She wears a light pink shirt and a white pajama bottom, as well as a bracelet on her left wrist, and is holding a small piece of popcorn. At first her mouth is closed, then she puts the popcorn into her mouth, her expression briefly shows concern; from the mid, she seems shocked by something in the screen at throw out the popcorn, and the expression turns fear. The fourth girl sits on the far right, with blonde, straight, long hair, big almond-shaped blue eyes, narrow blonde eyebrows, a small nose with a high bridge, and thick pink lips. She is wearing a light purple shirt with white and pink polka dot pajama pants. From the mid of video, she's chewing popcorn with her mouth closed, and again she is seen eating popcorn at the end. They all have fair, smooth skin and are focused forward. The lighting is from above with white light. The camera angle is front-facing and there is no camera movement. Figure 1: Selected examples of inputs and outputs obtained from VidEmo. Apart from providing toolkits for basic attribute perception and expression analysis (top), VidEmo extends the cognitive capacity and is able to generate fine-grained emotional captions with explainable rationale (bottom).

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning cites BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
  • Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning cites Learning Transferable Visual Models From Natural Language Supervision
  • Efficient Segmentation with Multimodal Large Language Model via Token Routing cites BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
  • Efficient Segmentation with Multimodal Large Language Model via Token Routing cites Learning Transferable Visual Models From Natural Language Supervision
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Efficient Segmentation with Multimodal Large Language Model via Token RoutingChangsong Wen, Zelin Peng, Yu Huang, Wei ShenAAAI 2026

Builds on31

  1. Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
  2. BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
  3. CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of ModalityWenmeng Yu, Hua Xu, Fanyang Meng, Yilin Zhu et al.ACL 2020 · 376 citations
  4. Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction TuningZebang Cheng, Zhi-Qi Cheng, Jun-Yan He, Kai Wang et al.NeurIPS 2024 · 293 citations
  5. Context-Aware Emotion Recognition NetworksJiyoung Lee, Seungryong Kim, Sunok Kim, Jungin Park et al.ICCV 2019 · 285 citations

Related papers

  1. MMHead: Towards Fine-grained Multi-modal 3D Facial AnimationSijing Wu, Yunhao Li, Yichao Yan, Huiyu Duan et al.ACM MM 2024 · 17 citations
  2. Digital Life Project: Autonomous 3D Characters with Social IntelligenceZhongang Cai, Jianping Jiang, Zhongfei Qing, Xinying Guo et al.CVPR 2024
  3. SEED-Bench: Benchmarking Multimodal Large Language ModelsBohao Li, Yuying Ge, Yixiao Ge, Guangzhi Wang et al.CVPR 2024
  4. EmotiV: Exploring Automatic Emotion Sharing through Facial Expression Recognition (FER) for Online Co-WatchingYusen Zhang, Edmond S. L. Ho, Sharon Xianghua DingCHI 2026 · 1 citation
  5. FriendsQA: A New Large-Scale Deep Video Understanding Dataset with Fine-grained Topic Categorization for Story VideosZhengqian Wu, Ruizhe Li, Zijun Xu, Zhongyuan Wang et al.AAAI 2025 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines