Alert button
Picture for Zuotong Wu

Zuotong Wu

Alert button

Difference-in-Differences: Bridging Normalization and Disentanglement in PG-GAN

Oct 16, 2020
Xiao Liu, Jiajie Zhang, Siting Li, Zuotong Wu, Yang Yu

Figure 1 for Difference-in-Differences: Bridging Normalization and Disentanglement in PG-GAN
Figure 2 for Difference-in-Differences: Bridging Normalization and Disentanglement in PG-GAN
Figure 3 for Difference-in-Differences: Bridging Normalization and Disentanglement in PG-GAN

What mechanisms causes GAN's entanglement? Although developing disentangled GAN has attracted sufficient attention, it is unclear how entanglement is originated by GAN transformation. We in this research propose a difference-in-difference (DID) counterfactual framework to design experiments for analyzing the entanglement mechanism in on of the Progressive-growing GAN (PG-GAN). Our experiment clarify the mechanisms how pixel normalization causes PG-GAN entanglement during a input-unit-ablation transformation. We discover that pixel normalization causes object entanglement by in-painting the area occupied by ablated objects. We also discover the unit-object relation determines whether and how pixel normalization causes objects entanglement. Our DID framework theoretically guarantees that the mechanisms that we discover is solid, explainable and comprehensively.

Viaarxiv icon