Alert button

CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion

Mar 21, 2023
Geonmo Gu, Sanghyuk Chun, Wonjae Kim, HeeJae Jun, Yoohoon Kang, Sangdoo Yun

Figure 1 for CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion
Figure 2 for CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion
Figure 3 for CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion
Figure 4 for CompoDiff: Versatile Composed Image Retrieval With Latent Diffusion

Share this with someone who'll enjoy it:

This paper proposes a novel diffusion-based model, CompoDiff, for solving Composed Image Retrieval (CIR) with latent diffusion and presents a newly created dataset of 18 million reference images, conditions, and corresponding target image triplets to train the model. CompoDiff not only achieves a new zero-shot state-of-the-art on a CIR benchmark such as FashionIQ but also enables a more versatile CIR by accepting various conditions, such as negative text and image mask conditions, which are unavailable with existing CIR methods. In addition, the CompoDiff features are on the intact CLIP embedding space so that they can be directly used for all existing models exploiting the CLIP space. The code and dataset used for the training, and the pre-trained weights are available at https://github.com/navervision/CompoDiff

* First two authors contributed equally; 23 pages, 4.8MB  
View paper onarxiv icon

Share this with someone who'll enjoy it: