Just Noticeable Difference Modeling for Deep Visual Features
Rui Zhao, Wenrui Li, Lin Zhu, Yajing Zheng, Weisi Lin
摘要
Deep visual features are increasingly used as the interface in vision systems, motivating the need to describe feature characteristics and control feature quality for machine perception. Just-noticeable difference (JND) characterizes the maximum imperceptible distortion for images under human or machine vision. Extending it to deep visual features naturally meets the above demand by providing a task-aligned tolerance boundary in feature space, offering a practical reference for controlling feature quality under constrained resources. We propose FeatJND, a task-aligned JND formulation that predicts the maximum tolerable per-feature perturbation map while preserving downstream task performance. We propose a FeatJND estimator at standardized split points and validate it across image classification, detection, and instance segmentation. Under matched distortion strength, FeatJND-based distortions consistently preserve higher task performance than unstructured Gaussian perturbations, and attribution visualizations suggest FeatJND can suppress non-critical feature regions. As an application, we further apply FeatJND to token-wise dynamic quantization and show that FeatJND-guided step-size allocation yields clear gains over random step-size permutation and global uniform step size under the same noise budget. Our code will be released after publication.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu 等ICCV 2021 · 被引用 31,683 次
- Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without ConvolutionsWenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan 等ICCV 2021 · 被引用 4,909 次
- Feature Coding in the Era of Large Models: Dataset, Test Conditions, and BenchmarkChangsheng Gao, Yifan Ma, Qiaoxi Chen, Yenan Xu 等ICCV 2025 · 被引用 3 次
- DT-UFC: Universal Large Model Feature Coding via Peaky-to-Balanced Distribution TransformationChangsheng Gao, Zijie Liu, Li Li, Dong Liu 等ACM MM 2025 · 被引用 2 次
- DDJND: Dual Domain Just Noticeable Difference in Multi-Source Content Images with Structural DiscrepancyMiaohui Wang, Zhenming Li, Wuyuan XieAAAI 2025 · 被引用 2 次
相关 Paper
- The Last Byte: Learning Just Enough for Machine-Oriented Image CompressionWuyuan Xie, Zhenming Li, Ye Liu, Jian Jin 等AAAI 2026
- Firing Bits Where It Matters: Spiking-Guided Just Recognizable Distortion Modeling for Machine-Centric Video CodingWuyuan Xie, Zhenming Li, Yuwu Lu, Di Lin 等AAAI 2026
- Just Noticeable Visual Redundancy Forecasting: A Deep Multimodal-Driven ApproachWuyuan Xie, Shukang Wang, Sukun Tian, Lirong Huang 等AAAI 2023 · 被引用 5 次
- Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-LoopWeixia Zhang, Dingquan Li, Xiongkuo Min, Guangtao Zhai 等NeurIPS 2022 · 被引用 55 次
- Quantized Feature Distillation for Network QuantizationKe Zhu, Yin-Yin He, Jianxin WuAAAI 2023 · 被引用 21 次
