Alert button

Integrating High-Resolution Tactile Sensing into Grasp Stability Prediction

Jun 12, 2022
Lachlan Chumbley, Morris Gu, Rhys Newbury, Jurgen Leitner, Akansel Cosgun

Figure 1 for Integrating High-Resolution Tactile Sensing into Grasp Stability Prediction
Figure 2 for Integrating High-Resolution Tactile Sensing into Grasp Stability Prediction
Figure 3 for Integrating High-Resolution Tactile Sensing into Grasp Stability Prediction
Figure 4 for Integrating High-Resolution Tactile Sensing into Grasp Stability Prediction

Share this with someone who'll enjoy it:

We investigate how high-resolution tactile sensors can be utilized in combination with vision and depth sensing, to improve grasp stability prediction. Recent advances in simulating high-resolution tactile sensing, in particular the TACTO simulator, enabled us to evaluate how neural networks can be trained with a combination of sensing modalities. With the large amounts of data needed to train large neural networks, robotic simulators provide a fast way to automate the data collection process. We expand on the existing work through an ablation study and an increased set of objects taken from the YCB benchmark set. Our results indicate that while the combination of vision, depth, and tactile sensing provides the best prediction results on known objects, the network fails to generalize to unknown objects. Our work also addresses existing issues with robotic grasping in tactile simulation and how to overcome them.

* 8 pages, 6 figures  
View paper onarxiv icon

Share this with someone who'll enjoy it: