Microsoft's Haptic PIVOT Gives Virtual Reality a Real Sense of Physical Touch and Haptic Feedback
Wrist-worn controller lets you grasp, throw, and catch physical objects — and can even simulate the feel of plucking an apple from a tree.
A trio of scientists at Microsoft Research have developed a novel technique for giving a virtual or augmented reality the feel of physical objects: Haptic PIVOT, a wrist-worn system that pushes objects into the user's hand.
"In recent years, steady progress in haptic controllers from Microsoft Research has moved us toward a virtual reality (VR) experience in which those feelings will be on par with the awe-inspiring and realistic visual renderings being produced today by head-mounted displays," the researchers claim. "With previous devices such as NormalTouch, we can simulate a virtual object’s surface inclination and texture on the tip of an individual’s index finger. CLAW enables a person to feel she’s grabbed an object between her fingers to explore its compliance and elasticity, and TORC allows a new level of dexterity, parallel to real life."
"Using these prototypes, an individual can feel the skin of a virtual apple, squeeze the virtual fruit, and move it around in her hand. However, to facilitate a complete interaction with that apple in its virtual surroundings, we also have to take into account the dynamics of the objects in the space. Now, with Haptic PIVOT, we bring the physics of forces to VR controllers. Worn on the wrist, PIVOT is a portable device with a haptic handle that moves in and out of the hand on demand."
The Haptic PIVOT is attached to the user's wrist, and spends much of its time hidden away along the forearm. A flick of the wrist, detected by an on-board accelerometer, rotates the controller handle into the palm of the wearer's hand — matching the position of an on-screen object, like an apple, so it touches the wearer's physical palm just as their virtual hand closes around an object.
"As the individual pulls the apple from the tree, she encounters the expected resistance from the branch on which it’s attached as PIVOT uses its motor to pull the haptic handle away from the hand," the researchers explain. "She experiences the resistance until the apple is detached—an action accompanied by a 'thud' sensation generated by the voice coil actuator—at which point, she then feels the impact and weight of the apple in her palm. Instead of pulling the handle away, PIVOT presses it into the palm, creating a sense of momentum and weight."
More details on the project can be found on the Microsoft Research website, while the resulting paper is also available for open-access download.