Teleoperation with Tactile Feedback based on a Capacitive Proximity Sensor Array

In this paper, we show our novel teleoperation system that mediates proximity perception at the slave system as tactile information to the user. We have equipped a robot’s end-effector with a capacitive proximity sensor array. Based on the proximity information, tactile feedback is generated for the user via a tactile display. Thus, the user can feel some of an object’s features through his fingers, without the need for establishing contact between the slave system and the object. In our setting, the proximity sensing-based feedback complements the visual feedback provided by a workspace camera and a robot tool camera. Both the sensor array and the tactile display, have a spatial resolution of 4×4. To evaluate the impact, we conducted a user study covering scenarios with visual occlusion and distortion in pre-touch and pre-manipulation phases. The study revealed an improvement in the accuracy of positioning of the end-effector when the visual and the tactile feedback were both provided to the user. The study also showed high acceptance of the new modality by the users.