Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed

Controllable Image Synthesis via SegVAE

Jul 17, 2020
Yen-Chi Cheng, Hsin-Ying Lee, Min Sun, Ming-Hsuan Yang



Flexible user controls are desirable for content creation and image editing. A semantic map is commonly used intermediate representation for conditional image generation. Compared to the operation on raw RGB pixels, the semantic map enables simpler user modification. In this work, we specifically target at generating semantic maps given a label-set consisting of desired categories. The proposed framework, SegVAE, synthesizes semantic maps in an iterative manner using conditional variational autoencoder. Quantitative and qualitative experiments demonstrate that the proposed model can generate realistic and diverse semantic maps. We also apply an off-the-shelf image-to-image translation model to generate realistic RGB images to better understand the quality of the synthesized semantic maps. Furthermore, we showcase several real-world image-editing applications including object removal, object insertion, and object replacement.

* ECCV 2020. Project page: https://yccyenchicheng.github.io/SegVAE/ Code: https://github.com/yccyenchicheng/SegVAE 


Share this with someone who'll enjoy it:

   Access Paper Source



Share this with someone who'll enjoy it: