Alert button

StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation

Jul 09, 2021
Wonjong Jang, Gwangjin Ju, Yucheol Jung, Jiaolong Yang, Xin Tong, Seungyong Lee

Figure 1 for StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation
Figure 2 for StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation
Figure 3 for StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation
Figure 4 for StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation

Share this with someone who'll enjoy it:

We present a caricature generation framework based on shape and style manipulation using StyleGAN. Our framework, dubbed StyleCariGAN, automatically creates a realistic and detailed caricature from an input photo with optional controls on shape exaggeration degree and color stylization type. The key component of our method is shape exaggeration blocks that are used for modulating coarse layer feature maps of StyleGAN to produce desirable caricature shape exaggerations. We first build a layer-mixed StyleGAN for photo-to-caricature style conversion by swapping fine layers of the StyleGAN for photos to the corresponding layers of the StyleGAN trained to generate caricatures. Given an input photo, the layer-mixed model produces detailed color stylization for a caricature but without shape exaggerations. We then append shape exaggeration blocks to the coarse layers of the layer-mixed model and train the blocks to create shape exaggerations while preserving the characteristic appearances of the input. Experimental results show that our StyleCariGAN generates realistic and detailed caricatures compared to the current state-of-the-art methods. We demonstrate StyleCariGAN also supports other StyleGAN-based image manipulations, such as facial expression control.

* ACM Trans. Graph., Vol. 40, No. 4, Article 116. Publication date: August 2021  * Accepted to SIGGRAPH 2021. For supplementary material, see http://cg.postech.ac.kr/papers/2021_StyleCariGAN_supp.zip  
View paper onarxiv icon

Share this with someone who'll enjoy it: