Search
Menu
Hamamatsu Corp. - Earth Innovations LB 2/24

Wearable Camera Devices Enable Human Motion Capture, Bare-hand Interactions

Facebook X LinkedIn Email
Researchers from Tokyo Institute of Technology, Carnegie Mellon University, the University of St. Andrews, and the University of New South Wales have developed a wrist-worn device that is able to estimate 3D hand poses for virtual reality applications.
The system is the first of its kind to estimate 3D hand poses using a camera focusing on the back of the hand. Courtesy of ACM, UIST.
The system is the first of its kind to estimate 3D hand poses using a camera focusing on the back of the hand. Courtesy of ACM, UIST.

The system consists of a camera that images the back of the hand and that is supported by a neural network called DorsalNet. The network is able to accurately recognize dynamic gestures, helping the device capture hand motions in mobile settings. According to the researchers, the system outperforms previous attempts at similar devices, with an average of 20% higher accuracy in recognizing dynamic hand gestures, and it achieves 75% accuracy in detecting 11 different grasp types.

Preliminary tests of the device showed that it’s possible to use the system for smart device control and for use as a virtual mouse or keyboard, supporting the scientists' belief that the research development could advance development of controllers supporting bare-hand interactions.

The technique has applications in augmented and virtual reality devices, too, which often require the use of data gloves that can hinder movement or controllers with limited sensing capabilities. 

Future improvements to the camera system, such as higher frame rates and light sensitivity, will be needed for real-world use. The researchers said they further envision the incorporation of their device into a smart watch. 

The research was presented at the 33rd Association of Computer Machinery Symposium on User Interface Software and Technology.
DataRay Inc. - ISO 11146-Compliant

Published: October 2020
Glossary
machine vision
Machine vision, also known as computer vision or computer sight, refers to the technology that enables machines, typically computers, to interpret and understand visual information from the world, much like the human visual system. It involves the development and application of algorithms and systems that allow machines to acquire, process, analyze, and make decisions based on visual data. Key aspects of machine vision include: Image acquisition: Machine vision systems use various...
virtual reality
Virtual reality (VR) is a computer-generated simulation of a three-dimensional environment or experience that can be interacted with and explored by an individual using electronic devices, such as a headset with a display. VR aims to create a sense of presence, immersing users in a computer-generated world that can be entirely fictional or a replication of the real world. It often involves the use of specialized hardware and software to provide a fully immersive and interactive experience. ...
Research & Technologycamerasmachine visionvirtual realityARVRgesture detectionGesture Recognitiongesture recognition systemsgesture controlgestureImagingsmart devicesTokyo Institute of TechnologycollaborationUniversity of St AndrewsUniversity of New South WalesCarnegie Mellon UniversityThe News Wire

We use cookies to improve user experience and analyze our website traffic as stated in our Privacy Policy. By using this website, you agree to the use of cookies unless you have disabled them.