Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for Michael Zollhöfer

Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video


Dec 23, 2020
Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Christoph Lassner, Christian Theobalt

* Project page (incl. supplemental videos and code): https://gvv.mpi-inf.mpg.de/projects/nonrigid_nerf/ 

  Access Paper or Ask Questions

Learning Compositional Radiance Fields of Dynamic Human Heads


Dec 17, 2020
Ziyan Wang, Timur Bagautdinov, Stephen Lombardi, Tomas Simon, Jason Saragih, Jessica Hodgins, Michael Zollhöfer


  Access Paper or Ask Questions

Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction


Dec 05, 2020
Guy Gafni, Justus Thies, Michael Zollhöfer, Matthias Nießner

* Video: https://youtu.be/m7oROLdQnjk | Project page: https://gafniguy.github.io/4D-Facial-Avatars/ 

  Access Paper or Ask Questions

Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction


Dec 02, 2020
Aljaž Božič, Pablo Palafox, Michael Zollhöfer, Justus Thies, Angela Dai, Matthias Nießner

* Video: https://youtu.be/vyq36eFkdWo 

  Access Paper or Ask Questions

PIE: Portrait Image Embedding for Semantic Control


Sep 20, 2020
Ayush Tewari, Mohamed Elgharib, Mallikarjun B R., Florian Bernard, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt

* To appear in SIGGRAPH Asia 2020. Project webpage: https://gvv.mpi-inf.mpg.de/projects/PIE/ 

  Access Paper or Ask Questions

PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations


Aug 04, 2020
Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Carsten Stoll, Christian Theobalt

* 25 pages, including supplementary material 

  Access Paper or Ask Questions

Face2Face: Real-time Face Capture and Reenactment of RGB Videos


Jul 29, 2020
Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner

* CVPR2016 
* https://justusthies.github.io/posts/acm-research-highlight/ 

  Access Paper or Ask Questions

Neural Non-Rigid Tracking


Jun 23, 2020
Aljaž Božič, Pablo Palafox, Michael Zollhöfer, Angela Dai, Justus Thies, Matthias Nießner

* Video: https://youtu.be/nqYaxM6Rj8I 

  Access Paper or Ask Questions

State of the Art on Neural Rendering


Apr 08, 2020
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer

* Eurographics 2020 survey paper 

  Access Paper or Ask Questions

StyleRig: Rigging StyleGAN for 3D Control over Portrait Images


Mar 31, 2020
Ayush Tewari, Mohamed Elgharib, Gaurav Bharaj, Florian Bernard, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt

* CVPR 2020 (Oral). Project page: https://gvv.mpi-inf.mpg.de/projects/StyleRig/ 

  Access Paper or Ask Questions

DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data


Dec 09, 2019
Aljaž Božič, Michael Zollhöfer, Christian Theobalt, Matthias Nießner

* Video: https://youtu.be/OrHLacCDZVQ 

  Access Paper or Ask Questions

Neural Style-Preserving Visual Dubbing


Sep 06, 2019
Hyeongwoo Kim, Mohamed Elgharib, Michael Zollhöfer, Hans-Peter Seidel, Thabo Beeler, Christian Richardt, Christian Theobalt

* SIGGRAPH Asia 2019 

  Access Paper or Ask Questions

Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations


Jun 04, 2019
Vincent Sitzmann, Michael Zollhöfer, Gordon Wetzstein

* Video: https://youtu.be/6vMEBWD8O20 Project page: https://vsitzmann.github.io/srns/ 

  Access Paper or Ask Questions

Text-based Editing of Talking-head Video


Jun 04, 2019
Ohad Fried, Ayush Tewari, Michael Zollhöfer, Adam Finkelstein, Eli Shechtman, Dan B Goldman, Kyle Genova, Zeyu Jin, Christian Theobalt, Maneesh Agrawala

* A version with higher resolution images can be downloaded from the authors' website 

  Access Paper or Ask Questions

DEMEA: Deep Mesh Autoencoders for Non-Rigidly Deforming Objects


May 24, 2019
Edgar Tretschk, Ayush Tewari, Michael Zollhöfer, Vladislav Golyanik, Christian Theobalt

* 13 pages, including supplementary material 

  Access Paper or Ask Questions

Deferred Neural Rendering: Image Synthesis using Neural Textures


Apr 28, 2019
Justus Thies, Michael Zollhöfer, Matthias Nießner

* Video: https://youtu.be/z-pVip6WeyY SIGGRAPH 2019 

  Access Paper or Ask Questions

Commodity RGB-D Sensors: Data Acquisition


Feb 18, 2019
Michael Zollhöfer

* Contributed chapter to a book on "RGB-D Image Analysis and Processing" 

  Access Paper or Ask Questions

FML: Face Model Learning from Videos


Dec 18, 2018
Ayush Tewari, Florian Bernard, Pablo Garrido, Gaurav Bharaj, Mohamed Elgharib, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt

* Video: https://www.youtube.com/watch?v=SG2BwxCw0lQ, Project Page: https://gvv.mpi-inf.mpg.de/projects/FML19/ 

  Access Paper or Ask Questions

DeepVoxels: Learning Persistent 3D Feature Embeddings


Dec 03, 2018
Vincent Sitzmann, Justus Thies, Felix Heide, Matthias Nießner, Gordon Wetzstein, Michael Zollhöfer

* Video: https://www.youtube.com/watch?v=HM_WsZhoGXw Supplemental material: https://drive.google.com/file/d/1BnZRyNcVUty6-LxAstN83H79ktUq8Cjp/view?usp=sharing 

  Access Paper or Ask Questions

IGNOR: Image-guided Neural Object Rendering


Nov 26, 2018
Justus Thies, Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Nießner

* Video: https://youtu.be/s79HG9yn7QM 

  Access Paper or Ask Questions

HeadOn: Real-time Reenactment of Human Portrait Videos


May 29, 2018
Justus Thies, Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Nießner

* Video: https://www.youtube.com/watch?v=7Dg49wv2c_g Presented at Siggraph'18 

  Access Paper or Ask Questions

Deep Video Portraits


May 29, 2018
Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Nießner, Patrick Pérez, Christian Richardt, Michael Zollhöfer, Christian Theobalt

* SIGGRAPH 2018, Video: https://www.youtube.com/watch?v=qc5P2bvfl44 

  Access Paper or Ask Questions

InverseFaceNet: Deep Monocular Inverse Face Rendering


May 16, 2018
Hyeongwoo Kim, Michael Zollhöfer, Ayush Tewari, Justus Thies, Christian Richardt, Christian Theobalt

* CVPR 2018 (poster) 10 pages (+5 pages) 

  Access Paper or Ask Questions

Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hz


Mar 29, 2018
Ayush Tewari, Michael Zollhöfer, Pablo Garrido, Florian Bernard, Hyeongwoo Kim, Patrick Pérez, Christian Theobalt

* CVPR 2018 (Oral). Project webpage: https://gvv.mpi-inf.mpg.de/projects/FML/ 

  Access Paper or Ask Questions

FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality


Mar 21, 2018
Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner

* Video: https://youtu.be/jIlujM5avU8 Presented at Siggraph'18 

  Access Paper or Ask Questions

MonoPerfCap: Human Performance Capture from Monocular Video


Feb 23, 2018
Weipeng Xu, Avishek Chatterjee, Michael Zollhöfer, Helge Rhodin, Dushyant Mehta, Hans-Peter Seidel, Christian Theobalt

* Accepted to ACM TOG 2018, to be presented on SIGGRAPH 2018 

  Access Paper or Ask Questions

IMU2Face: Real-time Gesture-driven Facial Reenactment


Dec 18, 2017
Justus Thies, Michael Zollhöfer, Matthias Nießner

* https://youtu.be/UXGodiDAqiE 

  Access Paper or Ask Questions

MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction


Dec 07, 2017
Ayush Tewari, Michael Zollhöfer, Hyeongwoo Kim, Pablo Garrido, Florian Bernard, Patrick Pérez, Christian Theobalt

* International Conference on Computer Vision (ICCV) 2017 (Oral), 13 pages 

  Access Paper or Ask Questions

Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging


Sep 09, 2017
Zachary DeVito, Michael Mara, Michael Zollhöfer, Gilbert Bernstein, Jonathan Ragan-Kelley, Christian Theobalt, Pat Hanrahan, Matthew Fisher, Matthias Nießner


  Access Paper or Ask Questions