Alert button

FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views

Mar 25, 2023
Vinoj Jayasundara, Amit Agrawal, Nicolas Heron, Abhinav Shrivastava, Larry S. Davis

Figure 1 for FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views
Figure 2 for FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views
Figure 3 for FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views
Figure 4 for FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views

Share this with someone who'll enjoy it:

We present FlexNeRF, a method for photorealistic freeviewpoint rendering of humans in motion from monocular videos. Our approach works well with sparse views, which is a challenging scenario when the subject is exhibiting fast/complex motions. We propose a novel approach which jointly optimizes a canonical time and pose configuration, with a pose-dependent motion field and pose-independent temporal deformations complementing each other. Thanks to our novel temporal and cyclic consistency constraints along with additional losses on intermediate representation such as segmentation, our approach provides high quality outputs as the observed views become sparser. We empirically demonstrate that our method significantly outperforms the state-of-the-art on public benchmark datasets as well as a self-captured fashion dataset. The project page is available at: https://flex-nerf.github.io/

* CVPR 2023  
View paper onarxiv icon

Share this with someone who'll enjoy it: