Alert button

Coherent Loss: A Generic Framework for Stable Video Segmentation

Oct 25, 2020
Mingyang Qian, Yi Fu, Xiao Tan, Yingying Li, Jinqing Qi, Huchuan Lu, Shilei Wen, Errui Ding

Figure 1 for Coherent Loss: A Generic Framework for Stable Video Segmentation
Figure 2 for Coherent Loss: A Generic Framework for Stable Video Segmentation
Figure 3 for Coherent Loss: A Generic Framework for Stable Video Segmentation
Figure 4 for Coherent Loss: A Generic Framework for Stable Video Segmentation

Share this with someone who'll enjoy it:

Video segmentation approaches are of great importance for numerous vision tasks especially in video manipulation for entertainment. Due to the challenges associated with acquiring high-quality per-frame segmentation annotations and large video datasets with different environments at scale, learning approaches shows overall higher accuracy on test dataset but lack strict temporal constraints to self-correct jittering artifacts in most practical applications. We investigate how this jittering artifact degrades the visual quality of video segmentation results and proposed a metric of temporal stability to numerically evaluate it. In particular, we propose a Coherent Loss with a generic framework to enhance the performance of a neural network against jittering artifacts, which combines with high accuracy and high consistency. Equipped with our method, existing video object/semantic segmentation approaches achieve a significant improvement in term of more satisfactory visual quality on video human dataset, which we provide for further research in this field, and also on DAVIS and Cityscape.

* 10 pages, 6 figures, 4 tables  
View paper onarxiv icon

Share this with someone who'll enjoy it: