Our STS sensor before and during contact (right column) with a cabinet knob (middle column) during a door opening task (left column). In visual mode, the camera sees through the gel membrane, allowing the knob to be found, while tactile mode provides contact-based feedback, via gel deformation and resultant dot displacement, upon initial contact and during opening. Red circles highlight the knob in the sensor view.
In a recent T-RO paper, researchers show how complex manipulation tasks that require both precise reaching and controlled slipping or sliding can benefit from see-through visuotactile sensing.
ieeexplore.ieee.org/document/108...
#RobotSensingSystems #TactileSensor #ImitationLearning