Alert button

General Image-to-Image Translation with One-Shot Image Guidance

Jul 20, 2023
Bin Cheng, Zuhao Liu, Yunbo Peng, Yue Lin

Figure 1 for General Image-to-Image Translation with One-Shot Image Guidance
Figure 2 for General Image-to-Image Translation with One-Shot Image Guidance
Figure 3 for General Image-to-Image Translation with One-Shot Image Guidance
Figure 4 for General Image-to-Image Translation with One-Shot Image Guidance

Share this with someone who'll enjoy it:

Large-scale text-to-image models pre-trained on massive text-image pairs show excellent performance in image synthesis recently. However, image can provide more intuitive visual concepts than plain text. People may ask: how can we integrate the desired visual concept into an existing image, such as our portrait? Current methods are inadequate in meeting this demand as they lack the ability to preserve content or translate visual concepts effectively. Inspired by this, we propose a novel framework named visual concept translator (VCT) with the ability to preserve content in the source image and translate the visual concepts guided by a single reference image. The proposed VCT contains a content-concept inversion (CCI) process to extract contents and concepts, and a content-concept fusion (CCF) process to gather the extracted information to obtain the target image. Given only one reference image, the proposed VCT can complete a wide range of general image-to-image translation tasks with excellent results. Extensive experiments are conducted to prove the superiority and effectiveness of the proposed methods. Codes are available at https://github.com/CrystalNeuro/visual-concept-translator.

* accepted by ICCV 2023  
View paper onarxiv icon

Share this with someone who'll enjoy it: