NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learning
Tony Ng, Hyo Jin Kim, Vincent T. Lee, Daniel DeTone, Tsun-Yi Yang, Tianwei Shen, Eddy Ilg, Vassileios Balntas, Krystian Mikolajczyk, Chris Sweeney
Abstract
In the light of recent analyses on privacy-concerning scene revelation from visual descriptors, we develop descriptors that conceal the input image content. In particular, we propose an adversarial learning framework for training visual descriptors that prevent image reconstruction, while maintaining the matching accuracy. We let a feature encoding network and image reconstruction network compete with each other, such that the feature encoder tries to impede the image reconstruction with its generated descriptors, while the reconstructor tries to recover the input image from the descriptors. The experimental results demonstrate that the visual descriptors obtained with our method significantly deteriorate the image reconstruction quality with minimal impact on correspondence matching and camera localization performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 12e97bf6-05af-437e-8618-05090f753689Cited by top-tier papers10
- SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic UnderstandingPaul-Edouard Sarlin, Eduard Trulls, Marc Pollefeys, Jan Hosang et al.NeurIPS 2023 · 52 citations
- LDP-Feat: Image Features with Local Differential PrivacyFrancesco Pittaluga, Bingbing ZhuangICCV 2023 · 13 citations
- DGC-GNN: Leveraging Geometry and Color Cues for Visual Descriptor-Free 2D-3D MatchingShuzhe Wang, Juho Kannala, Daniel BarathCVPR 2024 · 7 citations
- LDL: Line Distance Functions for Panoramic LocalizationJunho Kim, Changwoon Choi, Hojun Jang, Young Min KimICCV 2023 · 4 citations
- Efficient Privacy-Preserving Visual Localization Using 3D Ray CloudsHeejoon Moon, Chunghwan Lee, Je Hyeong HongCVPR 2024 · 3 citations
Builds on7
- HyNet: Learning Local Descriptor with Hybrid Similarity Measure and Triplet LossYurun Tian, Axel Barroso Laguna, Tony Ng, Vassileios Balntas et al.NeurIPS 2020 · 101 citations
- Adversarial Learning of Privacy-Preserving and Task-Oriented RepresentationsTaihong Xiao, Yi-Hsuan Tsai, Kihyuk Sohn, Manmohan Chandraker et al.AAAI 2020 · 87 citations
- Learning Privacy-preserving Optics for Human Pose EstimationCarlos Hinojosa, Juan Carlos Niebles, Henry ArguelloICCV 2021 · 63 citations
- Privacy Preserving Image Queries for Camera LocalizationPablo Speciale, Johannes L. Schönberger, Sudipta N. Sinha, Marc PollefeysICCV 2019 · 44 citations
- SuperGlue: Learning Feature Matching With Graph Neural NetworksPaul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, Andrew RabinovichCVPR 2020
Related papers
- Privacy-Preserving Image Features via Adversarial Affine Subspace EmbeddingsMihai Dusmanu, Johannes L. Schönberger, Sudipta N. Sinha, Marc PollefeysCVPR 2021
- Privacy-preserving Adversarial Facial FeaturesZhibo Wang, He Wang, Shuaifan Jin, Wenwen Zhang et al.CVPR 2023
- Hiding Visual Information via Obfuscating Adversarial PerturbationsZhigang Su, Dawei Zhou, Nannan Wang, Decheng Liu et al.ICCV 2023 · 16 citations
- DecAD: Decoupling Anomalies in Latent Space for Multi-Class Unsupervised Anomaly DetectionXiaolei Wang, Xiaoyang Wang, Huihui Bai, Eng Gee Lim et al.ICCV 2025 · 3 citations
- Learning Discrepant Transformations for Face Privacy ProtectionChenda Wei, Haoyue Wang, Zhenxing Qian, Sheng Li et al.ACM MM 2025
