Loading web-font TeX/Main/Regular
Proprioceptive State Estimation for Amphibious Tactile Sensing | IEEE Journals & Magazine | IEEE Xplore

Proprioceptive State Estimation for Amphibious Tactile Sensing

; ; ; ; ;
Open Access

Abstract:

This article presents a novel vision-based proprioception approach for a soft robotic finger that can estimate and reconstruct tactile interactions in terrestrial and aqu...Show More
Topic: Tactile Robotics

Abstract:

This article presents a novel vision-based proprioception approach for a soft robotic finger that can estimate and reconstruct tactile interactions in terrestrial and aquatic environments. The key to this system lies in the finger's unique metamaterial structure, which facilitates omnidirectional passive adaptation during grasping, protecting delicate objects across diverse scenarios. A compact in-finger camera captures high-framerate images of the finger's deformation during contact, extracting crucial tactile data in real time. We present a volumetric discretized model of the soft finger and use the geometry constraints captured by the camera to find the optimal estimation of the deformed shape. The approach is benchmarked using a motion capture system with sparse markers and a haptic device with dense measurements. Both results show state-of-the-art accuracy, with a median error of 1.96 mm for overall body deformation, corresponding to 2.1\% of the finger's length. More importantly, the state estimation is robust in both on-land and underwater environments as we demonstrate its usage for underwater object shape sensing. This combination of passive adaptation and real-time tactile sensing paves the way for amphibious robotic grasping applications.
Topic: Tactile Robotics
Published in: IEEE Transactions on Robotics ( Volume: 40)
Page(s): 4662 - 4676
Date of Publication: 18 September 2024

ISSN Information:

Funding Agency:


References

References is not available for this document.