Dr. RAW: Towards General High-Level Vision from RAW with Efficient Task Conditioning
Wenjun Huang, Ziteng Cui, Yinqiang Zheng, Yirui He, Tatsuya Harada, Mohsen Imani
摘要
We introduce Dr. RAW , a unified and tuning-efficient framework for high-level computer vision tasks directly operating on camera RAW data. Unlike previous approaches that optimize image signal processing (ISP) pipelines and fully fine-tune networks for each task, Dr. RAW achieves state-of-the-art performance with minimal parameter updates and frozen backbone weights. At the input stage, we apply lightweight pre-processing steps, including sensor and illumination mapping, along with re-mosaicing, to mitigate data inconsistencies stemming from sensor variations and lighting conditions. At the network level, we introduce task-specific adaptation through two modules: Sensor Prior Prompts (SPP) and task-specific Low-Rank Adaptation (LoRA). SPP injects sensor-aware conditioning into the network via learnable prompts derived from RAW pixel distribution priors, while LoRA enables efficient task-specific tuning by updating only low-rank matrices in key backbone layers. Despite minimal tuning, Dr. RAW delivers superior results across four RAW-based tasks (object detection, semantic segmentation, instance segmentation, and pose estimation) on nine datasets encompassing various light conditions. By harnessing the intrinsic physical cues of RAW alongside parameter-efficient techniques, Dr. RAW advances RAW-based vision systems, achieving both high accuracy and computational economy. The source code is available here.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper24
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu 等ICCV 2021 · 被引用 31,683 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Segment Anything in High QualityLei Ke, Mingqiao Ye, Martin Danelljan, Yifan Liu 等NeurIPS 2023 · 被引用 709 次
- Surgical Fine-Tuning Improves Adaptation to Distribution ShiftsYoonho Lee, Annie S. Chen, Fahim Tajwar, Ananya Kumar 等ICLR 2023 · 被引用 47 次
- ReconfigISP: Reconfigurable Camera Image Processing PipelineKe Yu, Zexian Li, Yue Peng, Chen Change Loy 等ICCV 2021 · 被引用 46 次
相关 Paper
- Beyond RGB: Adaptive Parallel Processing for RAW Object DetectionShani Gamrian, Hila Barel, Feiran Li, Masakazu Yoshimura 等ICCV 2025 · 被引用 4 次
- Task-Aware Image Signal Processor for Advanced Visual PerceptionKai Chen, Jin Xiao, Leheng Zhang, Kexuan Shi 等CVPR 2026 · 被引用 3 次
- SpiralDiff: Spiral Diffusion with LoRA for RGB-to-RAW Conversion Across CamerasHuanjing Yue, Shangbin Xie, Cong Cao, Qian Wu 等CVPR 2026
- LoRA3D: Low-Rank Self-Calibration of 3D Geometric Foundation modelsZiqi Lu, Heng Yang, Danfei Xu, Boyi Li 等ICLR 2025
- Correlated Low-Rank Adaptation for ConvNetsWu Ran, Weijia Zhang, Shuyang Pang, Qi Zhu 等NeurIPS 2025 · 被引用 5 次
