Alert button

SegGPT: Segmenting Everything In Context

Apr 06, 2023
Xinlong Wang, Xiaosong Zhang, Yue Cao, Wen Wang, Chunhua Shen, Tiejun Huang

Figure 1 for SegGPT: Segmenting Everything In Context
Figure 2 for SegGPT: Segmenting Everything In Context
Figure 3 for SegGPT: Segmenting Everything In Context
Figure 4 for SegGPT: Segmenting Everything In Context

Share this with someone who'll enjoy it:

We present SegGPT, a generalist model for segmenting everything in context. We unify various segmentation tasks into a generalist in-context learning framework that accommodates different kinds of segmentation data by transforming them into the same format of images. The training of SegGPT is formulated as an in-context coloring problem with random color mapping for each data sample. The objective is to accomplish diverse tasks according to the context, rather than relying on specific colors. After training, SegGPT can perform arbitrary segmentation tasks in images or videos via in-context inference, such as object instance, stuff, part, contour, and text. SegGPT is evaluated on a broad range of tasks, including few-shot semantic segmentation, video object segmentation, semantic segmentation, and panoptic segmentation. Our results show strong capabilities in segmenting in-domain and out-of-domain targets, either qualitatively or quantitatively.

* Code and Demo: https://github.com/baaivision/Painter  
View paper onarxiv icon

Share this with someone who'll enjoy it: