This curated list of papers related to all-in-one image/video restoration. All-in-one image/video restoration aims to handle multiple degradations with one model [1].
We mark works contributed by ourselves with ⭐.
This repository now is maintained by Boyun Li, Yuanbiao Gou and Haiyu Zhao, feel free to contact us if you have any questions.
Blind all-in-one image restoration aims to recover corrupted images from multiple unknown degradations with one model.
Non-blind all-in-one image restoration requires to know the degradation types or/and levels in advance and leverages the degradation knowledge to perform targeted restoration with one model.
[2024 ICML]⭐ Test-Time Degradation Adaption for Open-Set Image Restoration
Yuanbiao Gou, Haiyu Zhao, Boyun Li, Xinyan Xiao, Xi Peng
[paper] [code]
-
[2022 CVPR]⭐ All-In-One Image Restoration for Unknown Corruption
Boyun Li, Xiao Liu, Peng Hu, Zhongqin Wu, Jiancheng Lv, Xi Peng
[paper] [code] -
[2022 CVPR]TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions
Jeya Maria Jose Valanarasu, Rajeev Yasarla, Vishal M. Patel
[paper] [code]
-
[2023 NeurIPS]PromptIR: Prompting for All-in-One Blind Image Restoration
Vaishnav Potlapalli, Syed Waqas Zamir, Salman Khan, Fahad Shahbaz Khan
[paper] [code] -
[2023 CVPR]Ingredient-oriented Multi-Degradation Learning for Image Restoration
Jinghao Zhang, Jie Huang, Mingde Yao, Zizheng Yang, Hu Yu, Man Zhou, Feng Zhao
[paper] [code] -
[2023 CVPR]Learning Weather-General and Weather-Specific Features for Image Restoration Under Multiple Adverse Weather Conditions
Yurui Zhu, Tianyu Wang, Xueyang Fu, Xuanyu Yang, Xin Guo, Jifeng Dai, Yu Qiao, Xiaowei Hu
[paper] [code] -
[2023 ICCV]Adverse Weather Removal with Codebook Priors
Tian Ye, Sixiang Chen, Jinbin Bai, Jun Shi, Chenghao Xue, Jingxia Jiang, Junjie Yin, Erkang Chen, Yun Liu
[paper] [code] -
[2023 TPAMI]Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Models
Ozan Özdenizci, Robert Legenstein
[paper] [code] -
[2023 Arxiv]Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration
Yuang Ai, Huaibo Huang, Xiaoqiang Zhou, Jiexiang Wang, Ran He
[paper] -
[2023 Arxiv]Prompt-In-Prompt Learning for Universal Image Restoration
Zilong Li, Yiming Lei, Chenglong Ma, Junping Zhang, Hongming Shan
[paper] [code] -
[2023 Arxiv]RDM-IR: Task-Adaptive Deep Unfolding Network for All-In-One Image Restoration
Yuanshuo Cheng, Mingwen Shao, Yecong Wan, Chao Wang
[paper] [code] -
[2023 Arxiv]Language-driven All-in-one Adverse Weather Removal
Hao Yang, Liyuan Pan, Yan Yang, Wei Liang
[paper] -
[2023 Arxiv]Always Clear Days: Degradation Type and Severity Aware All-In-One Adverse Weather Removal
Yu-Wei Chen, Soo-Chang Pei
[paper] [code]
-
[2024 ICLR]Controlling Vision-Language Models for Universal Image Restoration
Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund, Thomas B. Schön
[paper] [code] -
[2024 CVPR]Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model
Dian Zheng, Xiao-Ming Wu, Shuzhou Yang, Jian Zhang, Jian-Fang Hu, Wei-Shi Zheng
[paper] [code] -
[2024 ECCV]Restoring Images in Adverse Weather Conditions via Histogram Transformer
Shangquan Sun, Wenqi Ren, Xinwei Gao, Rui Wang, Xiaochun Cao
[paper] [code] -
[2024 ECCV]AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion
Yitong Jiang, Zhaoyang Zhang, Tianfan Xue, Jinwei Gu
[paper] [code] -
[2024 ACM MM]Learning A Low-Level Vision Generalist via Visual Task Prompt
Xiangyu Chen, Yihao Liu, Yuandong Pu, Wenlong Zhang, Jiantao Zhou, Yu Qiao, Chao Dong
[paper] [code] -
[2024 MICCAI]All-In-One Medical Image Restoration via Task-Adaptive Routing
Zhiwen Yang, Haowei Chen, Ziniu Qian, Yang Yi, Hui Zhang, Dan Zhao, Bingzheng Wei, Yan Xu
[paper] [code] -
[2024 Arxiv]AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulation
Yuning Cui, Syed Waqas Zamir, Salman Khan, Alois Knoll, Mubarak Shah, Fahad Shahbaz Khan
[paper] [code]
[2020 CVPR]All in One Bad Weather Removal Using Architectural Search
Ruoteng Li, Robby T. Tan, Loong-Fah Cheong
[paper]
-
[2021 CVPR]Pre-Trained Image Processing Transformer
Hanting Chen, Yunhe Wang, Tianyu Guo, Chang Xu, Yiping Deng, Zhenhua Liu, Siwei Ma, Chunjing Xu, Chao Xu, Wen Gao
[paper] [code] -
[2021 TPAMI]A General Decoupled Learning Framework for Parameterized Image Operators
Qingnan Fan, Dongdong Chen, Lu Yuan, Gang Hua, Nenghai Yu, Baoquan Chen
[paper] [code] -
[2021 Arxiv]On Efficient Transformer-Based Image Pre-training for Low-Level Vision
Wenbo Li, Xin Lu, Shengju Qian, Jiangbo Lu, Xiangyu Zhang, Jiaya Jia
[paper] [code]
[2022 ECCV]TAPE: Task-Agnostic Prior Embedding for Image Restoration
Lin Liu, Lingxi Xie, Xiaopeng Zhang, Shanxin Yuan, Xiangyu Chen, Wengang Zhou, Houqiang Li, Qi Tian
[paper] [code]
-
[2023 CVPR]Generative Diffusion Prior for Unified Image Restoration and Enhancement
Ben Fei, Zhaoyang Lyu, Liang Pan, Junzhe Zhang, Weidong Yang, Tianyue Luo, Bo Zhang, Bo Dai
[paper] [code] -
[2023 Arxiv]Exploring Degradation-aware Visual Prompt for Universal Image Restoration
Jiaqi Ma, Tianheng Cheng, Guoli Wang, Qian Zhang, Xinggang Wang, Lefei Zhang
[paper] [code]
[2024 ECCV]InstructIR: High-Quality Image Restoration Following Human Instructions
Marcos V. Conde, Gregor Geigle, Radu Timofte
[paper] [code]
-
[2023 ICCV]Video Adverse-Weather-Component Suppression Network via Weather Messenger and Adversarial Backpropagation
Yijun Yang, Angelica I. Aviles-Rivero, Huazhu Fu, Ye Liu, Weiming Wang, Lei Zhu
[paper] [code] -
[2023 Arxiv]Cross-Consistent Deep Unfolding Network for Adaptive All-In-One Video Restoration
Yuanshuo Cheng, Mingwen Shao, Yecong Wan, Yuanjian Qiao, Wangmeng Zuo, Deyu Meng
[paper]
-
[2024 NeurIPS]⭐ All-in-one Video Restoration for Time-varying Unknown Degradations
Haiyu Zhao, Lei Tian, Xinyan Xiao, Peng Hu, Yuanbiao Gou, Xi Peng
[paper] [code] -
[2024 CVPR]Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal
Yijun Yang, Hongtao Wu, Angelica I. Aviles-Rivero, Yulun Zhang, Jing Qin, Lei Zhu
[paper] [code]
[2022 Arxiv]Relationship Quantification of Image Degradations
Wenxin Wang, Boyun Li, Yuanbiao Gou, Peng Hu, Xi Peng
[paper]