Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Generalized Feedback Loop for Joint Hand-Object Pose Estimation

Mar 25, 2019
Markus Oberweger, Paul Wohlhart, Vincent Lepetit


Share this with someone who'll enjoy it:


We propose an approach to estimating the 3D pose of a hand, possibly handling an object, given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by using a feedback loop. The components of this feedback loop are also Deep Networks, optimized using training data. This approach can be generalized to a hand interacting with an object. Therefore, we jointly estimate the 3D pose of the hand and the 3D pose of the object. Our approach performs en-par with state-of-the-art methods for 3D hand pose estimation, and outperforms state-of-the-art methods for joint hand-object pose estimation when using depth images only. Also, our approach is efficient as our implementation runs in real-time on a single GPU.

* Transactions on Pattern Analysis and Machine Intelligence 2019 
* arXiv admin note: substantial text overlap with arXiv:1609.09698 


   Access Paper Source



Share this with someone who'll enjoy it: