VisuoTouch

Enabling Haptic Feedback in Augmented Reality through Visual Cues.

The rapid advancements in Augmented Reality (AR) have recently included hand tracking frameworks that allow a system to under- stand the placement of a user’s hand in virtual space, allowing for hand interactions with AR content. However, the lack of haptic feedback leaves the user confounded on whether or not their hand has successfully collided with the virtual content. Furthermore, in poke-to-select interactions, the user is unaware that they have triggered the selection process. VisuoTouch is a system that enables the semblance of haptic feedback by providing visual cues. The cue illuminates the spot where the finger collides with the object. If the user continues to push through, a virtual finger is visualised as bending against the object, following real-world physics. We hope that by demonstrating this interesting approach, we can facilitate further exploration in the effectiveness and usefulness of these visual-haptic cues.

This work was accepted to the 2020 IEEE International Symposium on Mixed and Augmented Reality as a Demonstration.

https://ismar20.org/demonstrations/

View Paper

Project Gallery

We present a visual-haptic feedback system to provide psycho-physical responses to touching virtual objects without the need of physical peripherals. A) Our tracked hand pushing into a virtual cube has no feedback other than the smaller surface cue. B) By instead capturing the point and rendering a new finger placed using IK along the surface, C) we provide a visual haptic feedback event, as if the real hand was pushed against a physical surface.

As the user pushes their finger through the virtual content,the distance between the IK and Occlusion Hands increases. If the distance increases, the custom shader renders the IK hands more prominently and vice versa.

VisuoTouch

Project Gallery

I'd love to hear from you.