BiProLoRA: Bilevel Prompt LoRA for Real Scene Recovery
Nan An, Long Ma, Tengyu Ma, Zhu Liu, Yingchi Liu, Risheng Liu
摘要
The emergence of large generative models has substantially advanced learning-based scene recovery in the synthetic domain. However, applying these models directly to real scenarios reveals sub-optimal performance stemming from the significant distribution gap, alongside poor adaptation to complex and unforeseen degradations. Consequently, it is imperative to develop a real scene adaptation strategy that yields faithful restorations with reliable generalizability. To this end, we propose level mpt , a novel learning paradigm designed to effectively adapt pre-trained generative models for real scene recovery. First, we introduce a self-supervised distribution-fidelity learning scheme to calibrate the autoencoding pathway under task-irrelevant real distributions, thereby recovering high-fidelity textures. Subsequently, a bilevel joint modeling via hyperparameter optimization is further established, empowering robust synthetic-to-real adaptation for both seen and unseen scenes by exploiting the complementary advantages between LoRA and Prompts to foster mutual promotion. Extensive evaluations on diverse real adverse scenarios demonstrate our method's superiority, with comprehensive algorithm analyses proving our effectiveness. The code will be public released upon the acceptance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper29
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
相关 Paper
- Bilevel Layer-Positioning LoRA for Real Image DehazingYan Zhang, Long Ma, Yuxin Feng, Zhe Huang 等CVPR 2026 · 被引用 13 次
- ProLoG: Hybrid Prompt and LoRA Based Adaptation of Vision-Language Models for OOD GeneralizationJungwuk Park, Dong-Jun Han, Jaekyun MoonAAAI 2026
- Perceive, Understand and Restore: Real-World Image Super-Resolution with Autoregressive Multimodal Generative ModelsHongyang Wei, Shuaizheng Liu, Chun Yuan, Lei ZhangICCV 2025 · 被引用 4 次
- Modality-Agnostic Zeroth-Order LoRA Fine-Tuning for Black-Box Prompt OptimizationXingchen Li, Jia Zhang, Tianxing Man, Wenkang Wang 等KDD 2026
- Uni-DlLoRA: Style Fine-Tuning for Fashion Image TranslationFangjian Liao, Xingxing Zou, Waikeung WongACM MM 2024 · 被引用 4 次
