Partitioning for Intrinsic Model Inversion Resistance in Collaborative Inference
Rongke Liu, Youwen Zhu, Lei Zhou, Zhang Xianglong, Dong Wang
Abstract
In collaborative inference (CI), transmitting intermediate representations from edge devices enables model inversion attacks (MIA) that reconstruct the original inputs , while existing defenses mainly perturb shallow-layer at the cost of utility. We instead ask: where should an edge–cloud model be partitioned to obtain intrinsic resistance to MIA? We challenge the intuition that depth is the driver of MIA resistance, and show that depth is sufficient only insofar as it enables a representational transition; this transition is necessary for intrinsic resistance and is marked by an abrupt rise in the lower bound of . Correspondingly, the decisive variance term in the entropy bound shifts from a global variance to the intra-class mean-squared radius rather than dimensionality alone, yielding an -based criterion to locate the transition zone, or identify it post hoc from MIA outcomes, which we term the Golden Partition Zone (GPZ). We further explain how evolves during training and show that it can be controlled through the label distribution; we refer to this controllable dynamic behavior as the Neural Vortex, an analysis-backed explanatory concept. Across four representative deep vision models, partitioning at the GPZ yields over 4× higher reconstruction MSE compared to shallow splits; under entropy and inversion-model enhancements, decision-level representations provide 66% stronger resistance than feature-level ones, and we further observe that data type affects both the transition boundary and reconstruction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Improving Robustness to Model Inversion Attacks via Mutual Information RegularizationTianhao Wang, Yuheng Zhang, Ruoxi JiaAAAI 2021 · 98 citations
- Be Careful What You Smooth For: Label Smoothing Can Be a Privacy Shield but Also a Catalyst for Model Inversion AttacksLukas Struppek, Dominik Hintersdorf, Kristian KerstingICLR 2024 · 26 citations
- Theoretical Insights in Model Inversion Robustness and Conditional Entropy Maximization for Collaborative Inference SystemsSong Xia, Yi Yu, Wenhan Yang, Meiwen Ding et al.CVPR 2025
Related papers
- Measuring Data Reconstruction Defenses in Collaborative Inference SystemsMengda Yang, Ziang Li, Juan Wang, Hongxin Hu et al.NeurIPS 2022 · 18 citations
- Reimagining Mutual Information for Enhanced Defense against Data Leakage in Collaborative InferenceLin Duan, Jingwei Sun, Jinyuan Jia, Yiran Chen et al.NeurIPS 2024 · 5 citations
- Ginver: Generative Model Inversion Attacks Against Collaborative InferenceYupeng Yin, Xianglong Zhang, Huanle Zhang, Feng Li et al.WWW 2023 · 24 citations
- GAN You See Me? Enhanced Data Reconstruction Attacks against Split InferenceZiang Li, Mengda Yang, Yaxin Liu, Juan Wang et al.NeurIPS 2023 · 29 citations
- Bilateral Dependency Optimization: Defending Against Model-inversion AttacksXiong Peng, Feng Liu, Jingfeng Zhang, Long Lan et al.KDD 2022 · 20 citations
