IIMR: Intangible Mid-Air Interactions in a Mixed Reality Environment

A framework which equips the user with the ability to naturally interact with intangible virtual content in an immersive environment and not limit this interaction to gestures alone.

Augmented Reality has been getting increased traction lately with a plethora of AR-enabled devices on the market ranging from smartphones to commercial Head-Mounted Displays (HMDs) such as the Microsoft Hololens. With the rise in AR, a need exists for there to be a more natural and intuitive form of interaction with virtual content that does not interfere with the user experience. Moreover, advanced and sophisticated hardware such as the Leap Motion Controller makes this possible by employing sensors that can track hands accurately in real-time. This paper presents a framework, IIMR (Intangible Interactions in Mixed Reality), that operates over a network and allows for mid-air interactions using just the bare-hands. The aim is to provide researchers and developers an inexpensive and accessible solution for developing and prototyping hand interactions quickly in a mixed reality environment. The system consists of three modules, namely a Smartphone, a Google cardboard-like HMD, and a Leap Motion Controller. Diverse applications are developed to evaluate the framework, and the results from qualitative usability studies are outlined.

Project Gallery

I'd love to hear from you.

  • Black LinkedIn Icon

© 2020 by Rajshekar Reddy