Alert button

Decoder Denoising Pretraining for Semantic Segmentation

Add code
Alert button
May 23, 2022
Figure 1 for Decoder Denoising Pretraining for Semantic Segmentation
Figure 2 for Decoder Denoising Pretraining for Semantic Segmentation
Figure 3 for Decoder Denoising Pretraining for Semantic Segmentation
Figure 4 for Decoder Denoising Pretraining for Semantic Segmentation

Share this with someone who'll enjoy it:

Semantic segmentation labels are expensive and time consuming to acquire. Hence, pretraining is commonly used to improve the label-efficiency of segmentation models. Typically, the encoder of a segmentation model is pretrained as a classifier and the decoder is randomly initialized. Here, we argue that random initialization of the decoder can be suboptimal, especially when few labeled examples are available. We propose a decoder pretraining approach based on denoising, which can be combined with supervised pretraining of the encoder. We find that decoder denoising pretraining on the ImageNet dataset strongly outperforms encoder-only supervised pretraining. Despite its simplicity, decoder denoising pretraining achieves state-of-the-art results on label-efficient semantic segmentation and offers considerable gains on the Cityscapes, Pascal Context, and ADE20K datasets.

Share this with someone who'll enjoy it: