Lune

ACM MM2020Top-tier venue

Cross Corpus Physiological-based Emotion Recognition Using a Learnable Visual Semantic Graph Convolutional Network

Woan-Shiuan Chien, Hao-Chun Yang, Chi-Chun Lee

Abstract

Affective media videos have been used as stimulus to investigate an individual's affective-physio responses. In this study, we aim to develop a network learning strategy for robust cross-corpus emotion recognition using physiological features jointly with affective video content. Specifically, we present a novel framework of Visual Semantic Graph Learning Convolutional Network (VGLCN) for individual emotional state recognition using physiology on transfer learning tasks. The stimulus of videos content is integrated into learnable graph structure to weight the importance of physiology on the two emotion dimensions, valence and arousal. Furthermore, we evaluate our proposed framework on two public emotion databases with a rigorous cross validation method, and our model achieves the best unweighted average recall (UAR), which is 67.9%, 56.9% for arousal and 79.8%, 70.4% for valence on the cross datasets recognition experiments respectively. Further analyses reveal that 1) VGLCN is especially effective on transfer valence binary-task, 2) the physiological features (ECG, EDA) are very informative features for emotion recognition and 3) the affective media videos are important constraint to be included in the framework to stabilize the performance power.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. EEG-SCMM: Soft Contrastive Masked Modeling for Cross-Corpus EEG-Based Emotion RecognitionQile Liu, Weishan Ye, Lingli Zhang, Zhen LiangACM MM 2025 · 1 citation

Related papers

  1. Multi-Label Compound Expression Recognition: C-EXPR Database & NetworkDimitrios KolliasCVPR 2023
  2. An End-to-End Visual-Audio Attention Network for Emotion Recognition in User-Generated VideosSicheng Zhao, Yunsheng Ma, Yang Gu, Jufeng Yang et al.AAAI 2020 · 123 citations
  3. A Unimodal Valence-Arousal Driven Contrastive Learning Framework for Multimodal Multi-Label Emotion RecognitionWenjie Zheng, Jianfei Yu, Rui XiaACM MM 2024 · 8 citations
  4. EMOD: A Unified EEG Emotion Representation Framework Leveraging V-A Guided Contrastive LearningYuning Chen, Sha Zhao, Shijian Li, Gang PanAAAI 2026
  5. HeLo: Heterogeneous Multi-Modal Fusion with Label Correlation for Emotion Distribution LearningChuhang Zheng, Chunwei Tian, Jie Wen, Daoqiang Zhang et al.ACM MM 2025 · 13 citations
Dusk over the sea between two cliffs drawn in fine vertical lines