Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restoration
Journal:
arXiv
Published Date:
Apr 14, 2025
Abstract
All-in-one image restoration, addressing diverse degradation types with a
unified model, presents significant challenges in designing task-specific
prompts that effectively guide restoration across multiple degradation
scenarios. While adaptive prompt learning enables end-to-end optimization, it
often yields overlapping or redundant task representations. Conversely,
explicit prompts derived from pretrained classifiers enhance discriminability
but may discard critical visual information for reconstruction. To address
these limitations, we introduce Contrastive Prompt Learning (CPL), a novel
framework that fundamentally enhances prompt-task alignment through two
complementary innovations: a \emph{Sparse Prompt Module (SPM)} that efficiently
captures degradation-specific features while minimizing redundancy, and a
\emph{Contrastive Prompt Regularization (CPR)} that explicitly strengthens task
boundaries by incorporating negative prompt samples across different
degradation types. Unlike previous approaches that focus primarily on
degradation classification, CPL optimizes the critical interaction between
prompts and the restoration model itself. Extensive experiments across five
comprehensive benchmarks demonstrate that CPL consistently enhances
state-of-the-art all-in-one restoration models, achieving significant
improvements in both standard multi-task scenarios and challenging composite
degradation settings. Our framework establishes new state-of-the-art
performance while maintaining parameter efficiency, offering a principled
solution for unified image restoration.