PixTalk: Controlling Photorealistic Image Processing and Editing with Language
Marcos V. Conde, Zihao Lu, Radu Timofte
Abstract
The enitre image looks flat, I want an image with higher contrast.
The image looks too dark and cold, make it a bit warmer and brighter.
Can you make my photo look like in winter?
Figure 1. Given an image and text prompts for how to edit the image, our multi-task image processing model edits the image considering the human instructions. PixTalk, covers over 40 transformations that can be commonly found in photography software (e.g. Adobe Lightroom), and it generalizes of-the-shelf on real-world photographs from diverse cameras and sensors.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a27a14af-a660-4d3e-87e7-a4caa967aafcCited by top-tier papers1
Ask how each one uses itBuilds on24
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- SDEdit: Guided Image Synthesis and Editing with Stochastic Differential EquationsChenlin Meng, Yutong He, Yang Song, Jiaming Song et al.ICLR 2022 · 2,128 citations
- Prompt-to-Prompt Image Editing with Cross-Attention ControlAmir Hertz, Ron Mokady, Jay Tenenbaum, Kfir Aberman et al.ICLR 2023 · 361 citations
- All-In-One Image Restoration for Unknown CorruptionBoyun Li, Xiao Liu, Peng Hu, Zhongqin Wu et al.CVPR 2022 · 338 citations
Related papers
- Diff-Plugin: Revitalizing Details for Diffusion-Based Low-Level TasksYuhao Liu, Zhanghan Ke, Fang Liu, Nanxuan Zhao et al.CVPR 2024
- InstructPix2Pix: Learning to Follow Image Editing InstructionsTim Brooks, Aleksander Holynski, Alexei A. EfrosCVPR 2023
- Instruction-based Image Manipulation by Watching How Things MoveMingdeng Cao, Xuaner Zhang, Yinqiang Zheng, Zhihao XiaCVPR 2025
- Prompt-Guided Image-Adaptive Neural Implicit Lookup Tables for Interpretable Image EnhancementSatoshi KosugiACM MM 2024 · 2 citations
- Unifying Image Processing as Visual Prompting Question AnsweringYihao Liu, Xiangyu Chen, Xianzheng Ma, Xintao Wang et al.ICML 2024 · 37 citations
