FakeWorld 1.0: An Omni-modal Benchmark for Fake Media and Content
Yifeng Gao, Yifan Ding, Li Wang, Feida Huang, Ye Sun, Yixu Wang, Xin Wang, YUTAO WU, Hanxun Huang, Yunhao Feng, Yingshui Tan, Xingjun Ma, Yu-Gang Jiang
Abstract
The rapidly increasing realism of AI-generated media has intensified the spread of deceptive content and undermined public trust. Existing research largely treats this challenge along two separate axes: media authenticity, which assesses whether content is real or machine-generated, and content veracity, which evaluates semantic consistency and factual correctness. This separation overlooks how real-world deception jointly exploits both dimensions. In this work, we present FakeWorld 1.0, an omni-modal benchmark that unifies media authenticity and content veracity within a single evaluation framework. Along the media axis, FakeWorld spans text, audio, image, and video synthesis. Along the content axis, it systematically instantiates cross-modal semantic inconsistencies and factual errors. These two axes are jointly embedded in realistic web-based and streaming-style presentation scenarios, reflecting how multimodal deception is composed, contextualized, and delivered in practice. FakeWorld further provides explainable annotations in the form of per-instance rationales, enabling transparent and evidence-based analysis. Under a unified evaluation protocol, experiments on both open- and closed-source multimodal large language models (MLLMs) reveal fundamental capability limits and demonstrate FakeWorld’s effectiveness in exposing high-fidelity, mixed-source deception. Beyond the benchmark, we introduce OmniChecker, an agentic framwork that performs joint, explainable detection across both axes and produces evidence-backed diagnostic reports. We position FakeWorld 1.0 as a realistic stress test and a practical foundation for advancing scalable, explainable detection of fake multimodal content.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 133dfcbb-7baf-4587-9a77-2db829b0574dBuilds on7
- Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact ExplanationSiwei Wen, Junyan Ye, Peilin Feng, Hengrui Kang et al.NeurIPS 2025 · 82 citations
- GenVidBench: A 6-Million Benchmark for AI-Generated Video DetectionZhenliang Ni, Qiangyu Yan, Mouxiao Huang, Tianning Yuan et al.AAAI 2026 · 13 citations
- CNN-Generated Images Are Surprisingly Easy to Spot... for NowSheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens et al.CVPR 2020
- Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language ModelsJin Wang, Chenghui Lv, Xian Li, Shichao Dong et al.CVPR 2025
- TSVer: A Benchmark for Fact Verification Against Time-Series EvidenceMarek Strong, Andreas VlachosEMNLP 2025
Related papers
- Debate with Images: Detecting Deceptive Behaviors in Multimodal Large Language ModelsSitong Fang, Shiyi Hou, Kaile Wang, Boyuan Chen et al.ICML 2026
- AVFakeBench: A Comprehensive Audio-Video Forgery Detection Benchmark for AV-LMMsShuhan Xia, Peipei Li, Xuannan Liu, Dongsen Zhang et al.CVPR 2026 · 1 citation
- TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake DetectionJian-Yu Jiang-Lin, Kang-Yang Huang, Ling Zou, Ling Lo et al.CVPR 2026 · 5 citations
- FVBench: Benchmarking Deepfake Video Detection Capability of Large Multimodal ModelsWang Jiarui, Huiyu Duan, Juntong Wang, Xiongkuo MinCVPR 2026
- Omni-Fake: Benchmarking Unified Multimodal Social Media Deepfake DetectionTianxiao Li, Zhenglin Huang, Haiquan Wen, Yiwei He et al.CVPR 2026 · 5 citations
