DataGuard: A Non-intrusive Dataset Auditing Framework via Differential Information Forensics
Jiadong Lou, Wenxin Rong, Li Chen, Xing Gao, Rui Zhang, Xu Yuan
Abstract
Concerns over dataset misuse in deep learning have highlighted the need for effective auditing. Unlike existing intrusive methods that require dataset modifications, which risk model performance and security, we present DataGuard, a non-intrusive framework for quantitative dataset auditing. Specifically, DataGuard integrates three key components: 1) a differential comparison between the target dataset and auxiliary non-training datasets, 2) an information-forensic analysis establishing formal inequalities to distinguish training data; and 3) a multivariate statistical test that translates these discrepancies into rigorous auditing scores. Extensive experiments demonstrate that DataGuard can detect both full and partial dataset usage without false positives while remaining robust under diverse training scenarios, offering a principled, information-theoretic solution for transparent AI development.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on13
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Sleeper Agent: Scalable Hidden Trigger Backdoors for Neural Networks Trained from ScratchHossein Souri, Liam Fowl, Rama Chellappa, Micah Goldblum et al.NeurIPS 2022 · 184 citations
- Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright ProtectionYiming Li, Yang Bai, Yong Jiang, Yong Yang et al.NeurIPS 2022 · 161 citations
- Dataset Inference: Ownership Resolution in Machine LearningPratyush Maini, Mohammad Yaghini, Nicolas PapernotICLR 2021 · 155 citations
Related papers
- TeDA: A Testing Framework for Data Usage Auditing in Deep Learning Model DevelopmentXiangshan Gao, Jialuo Chen, Jingyi Wang, Jie Shi et al.ISSTA 2024
- Anonymity Unveiled: A Practical Framework for Auditing Data Use in Deep Learning ModelsZitao Chen, Karthik PattabiramanCCS 2025
- RAI2: Responsible Identity Audit Governing the Artificial IntelligenceTian Dong, Shaofeng Li, Guoxing Chen, Minhui Xue et al.NDSS 2023
- GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural NetworksBang Wu, He Zhang, Xiangwen Yang, Shuo Wang et al.NDSS 2024
- Copy, Right? A Testing Framework for Copyright Protection of Deep Learning ModelsJialuo Chen, Jingyi Wang, Tinglan Peng, Youcheng Sun et al.S&P 2022 · 94 citations
