A Shared Look: Detecting Deepfakes with Inter-Subject Neural Synchrony
Shiang Hu, Zhiwen Zha, Dongdong Jia, Yifan Hu, Guojun Liu, Yuhan Lin, Chao Shen, Zhao Lv
摘要
The rapid evolution of generative AI presents a significant challenge for Deepfake detection. While most research focuses on face-swapping, the emerging threat of "image-to-video" (I2V) forgeries is harder to detect and poses a greater risk. Traditional computer vision detectors rely on transient digital artifacts, which often lack interpretability and robustness against the new generation techniques. This study introduces a neuro-cognitive method, using dyadic electroencephalogram (EEG) to decode the human perception of authenticity. We recorded inter-brain synchrony via EEG hyperscanning from 15 participant pairs as they viewed a balanced set of authentic and AI-generated videos. Results showed that these shared neural response can classify video authenticity with an accuracy of up to 89.23% using our proposed Hyper-FusionNet. In addition, the biomarkers exhibited distinct patterns for different emotional valences, highlighting their versatility. These findings highlight the potential of inter-brain synchrony for detecting emerging deepfakes, offering a new perspective for enhancing user trust and digital literacy.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Celeb-DF: A Large-Scale Challenging Dataset for DeepFake ForensicsYuezun Li, Xin Yang, Pu Sun, Honggang Qi 等CVPR 2020
- HumanSAM: Classifying Human-Centric Forgery Videos in Human Spatial, Appearance, and Motion AnomalyChang Liu, Yunfan Ye, Fan Zhang, Qingyang Zhou 等ICCV 2025 · 被引用 6 次
- Audio-Visual Asynchrony Mitigation: Cross-Modal Alignment and Feature Reconstruction for Deepfake DetectionYan Wang, Qindong Sun, Dongzhu RongACM MM 2025 · 被引用 1 次
- Joint Audio-Visual Deepfake DetectionYipin Zhou, Ser-Nam LimICCV 2021 · 被引用 232 次
- Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective CuesTrisha Mittal, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera 等ACM MM 2020 · 被引用 314 次
