FakeWorld 1.0: An Omni-modal Benchmark for Fake Media and Content
Yifeng Gao, Yifan Ding, Li Wang, Feida Huang, Ye Sun, Yixu Wang, Xin Wang, YUTAO WU, Hanxun Huang, Yunhao Feng, Yingshui Tan, Xingjun Ma, Yu-Gang Jiang
摘要
The rapidly increasing realism of AI-generated media has intensified the spread of deceptive content and undermined public trust. Existing research largely treats this challenge along two separate axes: media authenticity, which assesses whether content is real or machine-generated, and content veracity, which evaluates semantic consistency and factual correctness. This separation overlooks how real-world deception jointly exploits both dimensions. In this work, we present FakeWorld 1.0, an omni-modal benchmark that unifies media authenticity and content veracity within a single evaluation framework. Along the media axis, FakeWorld spans text, audio, image, and video synthesis. Along the content axis, it systematically instantiates cross-modal semantic inconsistencies and factual errors. These two axes are jointly embedded in realistic web-based and streaming-style presentation scenarios, reflecting how multimodal deception is composed, contextualized, and delivered in practice. FakeWorld further provides explainable annotations in the form of per-instance rationales, enabling transparent and evidence-based analysis. Under a unified evaluation protocol, experiments on both open- and closed-source multimodal large language models (MLLMs) reveal fundamental capability limits and demonstrate FakeWorld’s effectiveness in exposing high-fidelity, mixed-source deception. Beyond the benchmark, we introduce OmniChecker, an agentic framwork that performs joint, explainable detection across both axes and produces evidence-backed diagnostic reports. We position FakeWorld 1.0 as a realistic stress test and a practical foundation for advancing scalable, explainable detection of fake multimodal content.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact ExplanationSiwei Wen, Junyan Ye, Peilin Feng, Hengrui Kang 等NeurIPS 2025 · 被引用 82 次
- GenVidBench: A 6-Million Benchmark for AI-Generated Video DetectionZhenliang Ni, Qiangyu Yan, Mouxiao Huang, Tianning Yuan 等AAAI 2026 · 被引用 13 次
- CNN-Generated Images Are Surprisingly Easy to Spot... for NowSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens 等CVPR 2020
- Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language ModelsJin Wang, Chenghui Lv, Xian Li, Shichao Dong 等CVPR 2025
- TSVer: A Benchmark for Fact Verification Against Time-Series EvidenceMarek Strong, Andreas VlachosEMNLP 2025
相关 Paper
- Debate with Images: Detecting Deceptive Behaviors in Multimodal Large Language ModelsSitong Fang, Shiyi Hou, Kaile Wang, Boyuan Chen 等ICML 2026
- AVFakeBench: A Comprehensive Audio-Video Forgery Detection Benchmark for AV-LMMsShuhan Xia, Peipei Li, Xuannan Liu, Dongsen Zhang 等CVPR 2026 · 被引用 1 次
- TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake DetectionJian-Yu Jiang-Lin, Kang-Yang Huang, Ling Zou, Ling Lo 等CVPR 2026 · 被引用 5 次
- FVBench: Benchmarking Deepfake Video Detection Capability of Large Multimodal ModelsWang Jiarui, Huiyu Duan, Juntong Wang, Xiongkuo MinCVPR 2026
- Omni-Fake: Benchmarking Unified Multimodal Social Media Deepfake DetectionTianxiao Li, Zhenglin Huang, Haiquan Wen, Yiwei He 等CVPR 2026 · 被引用 5 次
