Alert button

LOLNeRF: Learn from One Look

Nov 19, 2021
Daniel Rebain, Mark Matthews, Kwang Moo Yi, Dmitry Lagun, Andrea Tagliasacchi

Figure 1 for LOLNeRF: Learn from One Look
Figure 2 for LOLNeRF: Learn from One Look
Figure 3 for LOLNeRF: Learn from One Look
Figure 4 for LOLNeRF: Learn from One Look

Share this with someone who'll enjoy it:

We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object. While generating realistic images is no longer a difficult task, producing the corresponding 3D structure such that they can be rendered from different views is non-trivial. We show that, unlike existing methods, one does not need multi-view data to achieve this goal. Specifically, we show that by reconstructing many images aligned to an approximate canonical pose with a single network conditioned on a shared latent space, you can learn a space of radiance fields that models shape and appearance for a class of objects. We demonstrate this by training models to reconstruct object categories using datasets that contain only one view of each subject without depth or geometry information. Our experiments show that we achieve state-of-the-art results in novel view synthesis and competitive results for monocular depth prediction.

View paper onarxiv icon

Share this with someone who'll enjoy it: