Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox
Picture for Jun-Yan Zhu

Jun-Yan Zhu

Depth-supervised NeRF: Fewer Views and Faster Training for Free


Jul 06, 2021
Kangle Deng, Andrew Liu, Jun-Yan Zhu, Deva Ramanan

Figure 1 for Depth-supervised NeRF: Fewer Views and Faster Training for Free
Figure 2 for Depth-supervised NeRF: Fewer Views and Faster Training for Free
Figure 3 for Depth-supervised NeRF: Fewer Views and Faster Training for Free
Figure 4 for Depth-supervised NeRF: Fewer Views and Faster Training for Free
* Project page: http://www.cs.cmu.edu/~dsnerf/ GitHub: https://github.com/dunbar12138/DSNeRF 
  Access Paper or Ask Questions

Editing Conditional Radiance Fields


Jun 04, 2021
Steven Liu, Xiuming Zhang, Zhoutong Zhang, Richard Zhang, Jun-Yan Zhu, Bryan Russell

Figure 1 for Editing Conditional Radiance Fields
Figure 2 for Editing Conditional Radiance Fields
Figure 3 for Editing Conditional Radiance Fields
Figure 4 for Editing Conditional Radiance Fields
* Code: https://github.com/stevliu/editnerf Website: http://editnerf.csail.mit.edu/, v2 updated figure 8 and included additional details 
  Access Paper or Ask Questions

Ensembling with Deep Generative Views


Apr 29, 2021
Lucy Chai, Jun-Yan Zhu, Eli Shechtman, Phillip Isola, Richard Zhang

Figure 1 for Ensembling with Deep Generative Views
Figure 2 for Ensembling with Deep Generative Views
Figure 3 for Ensembling with Deep Generative Views
Figure 4 for Ensembling with Deep Generative Views
* CVPR 2021 camera ready version; code available at https://github.com/chail/gan-ensembling 
  Access Paper or Ask Questions

On Buggy Resizing Libraries and Surprising Subtleties in FID Calculation


Apr 22, 2021
Gaurav Parmar, Richard Zhang, Jun-Yan Zhu

Figure 1 for On Buggy Resizing Libraries and Surprising Subtleties in FID Calculation
Figure 2 for On Buggy Resizing Libraries and Surprising Subtleties in FID Calculation
Figure 3 for On Buggy Resizing Libraries and Surprising Subtleties in FID Calculation
Figure 4 for On Buggy Resizing Libraries and Surprising Subtleties in FID Calculation
* GitHub: https://www.github.com/GaParmar/clean-fid Website: https://www.cs.cmu.edu/~clean-fid/ 
  Access Paper or Ask Questions

Anycost GANs for Interactive Image Synthesis and Editing


Mar 04, 2021
Ji Lin, Richard Zhang, Frieder Ganz, Song Han, Jun-Yan Zhu

Figure 1 for Anycost GANs for Interactive Image Synthesis and Editing
Figure 2 for Anycost GANs for Interactive Image Synthesis and Editing
Figure 3 for Anycost GANs for Interactive Image Synthesis and Editing
Figure 4 for Anycost GANs for Interactive Image Synthesis and Editing
* Accepted to CVPR 2021. The code and demo are available: https://github.com/mit-han-lab/anycost-gan 
  Access Paper or Ask Questions

Understanding the Role of Individual Units in a Deep Neural Network


Sep 12, 2020
David Bau, Jun-Yan Zhu, Hendrik Strobelt, Agata Lapedriza, Bolei Zhou, Antonio Torralba

Figure 1 for Understanding the Role of Individual Units in a Deep Neural Network
Figure 2 for Understanding the Role of Individual Units in a Deep Neural Network
Figure 3 for Understanding the Role of Individual Units in a Deep Neural Network
Figure 4 for Understanding the Role of Individual Units in a Deep Neural Network
* Proceedings of the National Academy of Sciences 2020. Code at https://github.com/davidbau/dissect/ and website at https://dissect.csail.mit.edu/ 
  Access Paper or Ask Questions

The Hessian Penalty: A Weak Prior for Unsupervised Disentanglement


Aug 24, 2020
William Peebles, John Peebles, Jun-Yan Zhu, Alexei Efros, Antonio Torralba

Figure 1 for The Hessian Penalty: A Weak Prior for Unsupervised Disentanglement
Figure 2 for The Hessian Penalty: A Weak Prior for Unsupervised Disentanglement
Figure 3 for The Hessian Penalty: A Weak Prior for Unsupervised Disentanglement
Figure 4 for The Hessian Penalty: A Weak Prior for Unsupervised Disentanglement
* ECCV 2020 (Spotlight). Code available at https://github.com/wpeebles/hessian_penalty . Project page and videos available at https://www.wpeebles.com/hessian-penalty 
  Access Paper or Ask Questions

Contrastive Learning for Unpaired Image-to-Image Translation


Aug 20, 2020
Taesung Park, Alexei A. Efros, Richard Zhang, Jun-Yan Zhu

Figure 1 for Contrastive Learning for Unpaired Image-to-Image Translation
Figure 2 for Contrastive Learning for Unpaired Image-to-Image Translation
Figure 3 for Contrastive Learning for Unpaired Image-to-Image Translation
Figure 4 for Contrastive Learning for Unpaired Image-to-Image Translation
* ECCV 2020. Please visit https://taesungp.github.io/ContrastiveUnpairedTranslation/ for introduction videos and more. v3 contains typo fixes and citation update 
  Access Paper or Ask Questions

Rewriting a Deep Generative Model


Jul 30, 2020
David Bau, Steven Liu, Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba

Figure 1 for Rewriting a Deep Generative Model
Figure 2 for Rewriting a Deep Generative Model
Figure 3 for Rewriting a Deep Generative Model
Figure 4 for Rewriting a Deep Generative Model
* ECCV 2020 (oral). Code at https://github.com/davidbau/rewriting. For videos and demos see https://rewriting.csail.mit.edu/ 
  Access Paper or Ask Questions

Swapping Autoencoder for Deep Image Manipulation


Jul 01, 2020
Taesung Park, Jun-Yan Zhu, Oliver Wang, Jingwan Lu, Eli Shechtman, Alexei A. Efros, Richard Zhang

Figure 1 for Swapping Autoencoder for Deep Image Manipulation
Figure 2 for Swapping Autoencoder for Deep Image Manipulation
Figure 3 for Swapping Autoencoder for Deep Image Manipulation
Figure 4 for Swapping Autoencoder for Deep Image Manipulation

  Access Paper or Ask Questions

Differentiable Augmentation for Data-Efficient GAN Training


Jun 18, 2020
Shengyu Zhao, Zhijian Liu, Ji Lin, Jun-Yan Zhu, Song Han

Figure 1 for Differentiable Augmentation for Data-Efficient GAN Training
Figure 2 for Differentiable Augmentation for Data-Efficient GAN Training
Figure 3 for Differentiable Augmentation for Data-Efficient GAN Training
Figure 4 for Differentiable Augmentation for Data-Efficient GAN Training

  Access Paper or Ask Questions

Diverse Image Generation via Self-Conditioned GANs


Jun 18, 2020
Steven Liu, Tongzhou Wang, David Bau, Jun-Yan Zhu, Antonio Torralba

Figure 1 for Diverse Image Generation via Self-Conditioned GANs
Figure 2 for Diverse Image Generation via Self-Conditioned GANs
Figure 3 for Diverse Image Generation via Self-Conditioned GANs
Figure 4 for Diverse Image Generation via Self-Conditioned GANs
* CVPR 2020. Code: https://github.com/stevliu/self-conditioned-gan. Webpage: http://selfcondgan.csail.mit.edu/ 
  Access Paper or Ask Questions

Semantic Photo Manipulation with a Generative Image Prior


May 15, 2020
David Bau, Hendrik Strobelt, William Peebles, Jonas, Bolei Zhou, Jun-Yan Zhu, Antonio Torralba

Figure 1 for Semantic Photo Manipulation with a Generative Image Prior
Figure 2 for Semantic Photo Manipulation with a Generative Image Prior
Figure 3 for Semantic Photo Manipulation with a Generative Image Prior
Figure 4 for Semantic Photo Manipulation with a Generative Image Prior
* Bau, David, et al. "Semantic photo manipulation with a generative image prior." ACM Transactions on Graphics (TOG) 38.4 (2019) 
 * SIGGRAPH 2019 
  Access Paper or Ask Questions

Transforming and Projecting Images into Class-conditional Generative Networks


May 04, 2020
Minyoung Huh, Richard Zhang, Jun-Yan Zhu, Sylvain Paris, Aaron Hertzmann

Figure 1 for Transforming and Projecting Images into Class-conditional Generative Networks
Figure 2 for Transforming and Projecting Images into Class-conditional Generative Networks
Figure 3 for Transforming and Projecting Images into Class-conditional Generative Networks
Figure 4 for Transforming and Projecting Images into Class-conditional Generative Networks

  Access Paper or Ask Questions

State of the Art on Neural Rendering


Apr 08, 2020
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer

Figure 1 for State of the Art on Neural Rendering
Figure 2 for State of the Art on Neural Rendering
Figure 3 for State of the Art on Neural Rendering
Figure 4 for State of the Art on Neural Rendering
* Eurographics 2020 survey paper 
  Access Paper or Ask Questions

GAN Compression: Efficient Architectures for Interactive Conditional GANs


Mar 19, 2020
Muyang Li, Ji Lin, Yaoyao Ding, Zhijian Liu, Jun-Yan Zhu, Song Han

Figure 1 for GAN Compression: Efficient Architectures for Interactive Conditional GANs
Figure 2 for GAN Compression: Efficient Architectures for Interactive Conditional GANs
Figure 3 for GAN Compression: Efficient Architectures for Interactive Conditional GANs
Figure 4 for GAN Compression: Efficient Architectures for Interactive Conditional GANs

  Access Paper or Ask Questions

Seeing What a GAN Cannot Generate


Oct 24, 2019
David Bau, Jun-Yan Zhu, Jonas Wulff, William Peebles, Hendrik Strobelt, Bolei Zhou, Antonio Torralba

Figure 1 for Seeing What a GAN Cannot Generate
Figure 2 for Seeing What a GAN Cannot Generate
Figure 3 for Seeing What a GAN Cannot Generate
Figure 4 for Seeing What a GAN Cannot Generate
* ICCV 2019 oral; http://ganseeing.csail.mit.edu/ 
  Access Paper or Ask Questions

Connecting Touch and Vision via Cross-Modal Prediction


Jun 14, 2019
Yunzhu Li, Jun-Yan Zhu, Russ Tedrake, Antonio Torralba

Figure 1 for Connecting Touch and Vision via Cross-Modal Prediction
Figure 2 for Connecting Touch and Vision via Cross-Modal Prediction
Figure 3 for Connecting Touch and Vision via Cross-Modal Prediction
Figure 4 for Connecting Touch and Vision via Cross-Modal Prediction
* Accepted to CVPR 2019. Project Page: http://visgel.csail.mit.edu/ 
  Access Paper or Ask Questions

Semantic Image Synthesis with Spatially-Adaptive Normalization


Mar 18, 2019
Taesung Park, Ming-Yu Liu, Ting-Chun Wang, Jun-Yan Zhu

Figure 1 for Semantic Image Synthesis with Spatially-Adaptive Normalization
Figure 2 for Semantic Image Synthesis with Spatially-Adaptive Normalization
Figure 3 for Semantic Image Synthesis with Spatially-Adaptive Normalization
Figure 4 for Semantic Image Synthesis with Spatially-Adaptive Normalization
* CVPR 2019 
 * Accepted as a CVPR 2019 oral paper 
  Access Paper or Ask Questions

Visualizing and Understanding Generative Adversarial Networks (Extended Abstract)


Jan 29, 2019
David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B. Tenenbaum, William T. Freeman, Antonio Torralba

Figure 1 for Visualizing and Understanding Generative Adversarial Networks (Extended Abstract)
Figure 2 for Visualizing and Understanding Generative Adversarial Networks (Extended Abstract)
Figure 3 for Visualizing and Understanding Generative Adversarial Networks (Extended Abstract)
Figure 4 for Visualizing and Understanding Generative Adversarial Networks (Extended Abstract)
* In AAAI-19 workshop on Network Interpretability for Deep Learning arXiv admin note: substantial text overlap with arXiv:1811.10597 
  Access Paper or Ask Questions

GAN Dissection: Visualizing and Understanding Generative Adversarial Networks


Dec 08, 2018
David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B. Tenenbaum, William T. Freeman, Antonio Torralba

Figure 1 for GAN Dissection: Visualizing and Understanding Generative Adversarial Networks
Figure 2 for GAN Dissection: Visualizing and Understanding Generative Adversarial Networks
Figure 3 for GAN Dissection: Visualizing and Understanding Generative Adversarial Networks
Figure 4 for GAN Dissection: Visualizing and Understanding Generative Adversarial Networks
* 18 pages, 19 figures 
  Access Paper or Ask Questions

Visual Object Networks: Image Generation with Disentangled 3D Representation


Dec 06, 2018
Jun-Yan Zhu, Zhoutong Zhang, Chengkai Zhang, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum, William T. Freeman

Figure 1 for Visual Object Networks: Image Generation with Disentangled 3D Representation
Figure 2 for Visual Object Networks: Image Generation with Disentangled 3D Representation
Figure 3 for Visual Object Networks: Image Generation with Disentangled 3D Representation
Figure 4 for Visual Object Networks: Image Generation with Disentangled 3D Representation
* NeurIPS 2018. Code: https://github.com/junyanz/VON Website: http://von.csail.mit.edu/ 
  Access Paper or Ask Questions

Dataset Distillation


Nov 27, 2018
Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba, Alexei A. Efros

Figure 1 for Dataset Distillation
Figure 2 for Dataset Distillation
Figure 3 for Dataset Distillation
Figure 4 for Dataset Distillation

  Access Paper or Ask Questions

Toward Multimodal Image-to-Image Translation


Oct 24, 2018
Jun-Yan Zhu, Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A. Efros, Oliver Wang, Eli Shechtman

Figure 1 for Toward Multimodal Image-to-Image Translation
Figure 2 for Toward Multimodal Image-to-Image Translation
Figure 3 for Toward Multimodal Image-to-Image Translation
Figure 4 for Toward Multimodal Image-to-Image Translation
* NIPS 2017 Final paper. v4 updated acknowledgment. Website: https://junyanz.github.io/BicycleGAN/ 
  Access Paper or Ask Questions

3D-Aware Scene Manipulation via Inverse Graphics


Oct 11, 2018
Shunyu Yao, Tzu Ming Harry Hsu, Jun-Yan Zhu, Jiajun Wu, Antonio Torralba, William T. Freeman, Joshua B. Tenenbaum

Figure 1 for 3D-Aware Scene Manipulation via Inverse Graphics
Figure 2 for 3D-Aware Scene Manipulation via Inverse Graphics
Figure 3 for 3D-Aware Scene Manipulation via Inverse Graphics
Figure 4 for 3D-Aware Scene Manipulation via Inverse Graphics
* NIPS 2018 
  Access Paper or Ask Questions

Propagation Networks for Model-Based Control Under Partial Observation


Sep 28, 2018
Yunzhu Li, Jiajun Wu, Jun-Yan Zhu, Joshua B. Tenenbaum, Antonio Torralba, Russ Tedrake

Figure 1 for Propagation Networks for Model-Based Control Under Partial Observation
Figure 2 for Propagation Networks for Model-Based Control Under Partial Observation
Figure 3 for Propagation Networks for Model-Based Control Under Partial Observation
Figure 4 for Propagation Networks for Model-Based Control Under Partial Observation

  Access Paper or Ask Questions

Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks


Aug 30, 2018
Jun-Yan Zhu, Taesung Park, Phillip Isola, Alexei A. Efros

Figure 1 for Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
Figure 2 for Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
Figure 3 for Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
Figure 4 for Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
* An extended version of our ICCV 2017 paper, v5 (1) adds the link to CycleGAN PyTorch code and (2) fixes typos and formatting issues. 
  Access Paper or Ask Questions