Region-Aware Instance Consistency Learning for Micro-Expression Recognition
Yaomin Cai, C. L. Philip Chen, Shiting Xu, Haiqi Liu, Tong Zhang
Abstract
Micro-expression Recognition (MER) is challenging due to the subtle motion. Existing methods heavily rely on the onset/apex pair to capture the most discriminative motion clues. This paradigm struggles with labor-intensive apex annotation and effective utilization of data. In this paper, we propose a novel paradigm for MER that eliminates the need for expensive apex annotations while effectively capturing subtle motion dynamics. Our key insight is that frames within the sequence exhibit spatially consistent and intensity varied motion cues relative to the onset frame. Motivated by this, our method treats each sequence as a set of multiple onset/near-median motion instances. To fully exploit weaker motion information conveyed by these varied instances, our framework introduces an Instance Region Consistency (IRC) module that enforces visual attention consistency on similar facial activation regions across different instances within the same set. Furthermore, we present a Multi-Region Discovery (MRD) module with selfsupervised learning to expand attention on more subtle activation regions which are typically neglected. Extensive experiments on four public micro-expression datasets demonstrate that our proposed approach surpasses state-of-theart methods without using any apex frame annotations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5dab547e-39bd-4226-b3c6-1ceaec53f9bdBuilds on11
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Per-Pixel Classification is Not All You Need for Semantic SegmentationBowen Cheng, Alexander G. Schwing, Alexander KirillovNeurIPS 2021 · 2,196 citations
- Asymmetric Adversarial-based Feature Disentanglement Learning for Cross-Database Micro-Expression RecognitionShiting Xu, Zhiheng Zhou, Junyuan ShangACM MM 2022 · 8 citations
- A unique M-pattern for micro-expression spotting in long videosJinxuan Wang, Shiting Xu, Tong ZhangICLR 2024 · 3 citations
Related papers
- Feature Representation Learning with Adaptive Displacement Generation and Transformer Fusion for Micro-Expression RecognitionZhijun Zhai, Jianhui Zhao, Chengjiang Long, Wenju Xu et al.CVPR 2023
- Dynamic Stereotype Theory Induced Micro-expression Recognition with Oriented DeformationBohao Zhang, Xuejiao Wang, Changbo Wang, Gaoqi HeCVPR 2025
- SelfME: Self-Supervised Motion Learning for Micro-Expression RecognitionXinqi Fan, Xueli Chen, Mingjie Jiang, Ali Raza Shahid et al.CVPR 2023
- Multi-Information Hierarchical Fusion Transformer with Local Alignment and Global Correlation for Micro-Expression RecognitionJinsheng Wei, Jialiang Sun, Guanming Lu, Jingjie Yan et al.ACM MM 2025 · 5 citations
- Micron-BERT: BERT-Based Facial Micro-Expression RecognitionXuan-Bac Nguyen, Chi Nhan Duong, Xin Li, Susan Gauch et al.CVPR 2023
