Search Menu
Photonics Media Photonics Marketplace Photonics Spectra BioPhotonics Vision Spectra Photonics Showcase Photonics ProdSpec Photonics Handbook

Wearable Camera Devices Enable Human Motion Capture, Bare-hand Interactions

Facebook Twitter LinkedIn Email
Researchers from Tokyo Institute of Technology, Carnegie Mellon University, the University of St. Andrews, and the University of New South Wales have developed a wrist-worn device that is able to estimate 3D hand poses for virtual reality applications.
The system is the first of its kind to estimate 3D hand poses using a camera focusing on the back of the hand. Courtesy of ACM, UIST.
The system is the first of its kind to estimate 3D hand poses using a camera focusing on the back of the hand. Courtesy of ACM, UIST.

The system consists of a camera that images the back of the hand and that is supported by a neural network called DorsalNet. The network is able to accurately recognize dynamic gestures, helping the device capture hand motions in mobile settings. According to the researchers, the system outperforms previous attempts at similar devices, with an average of 20% higher accuracy in recognizing dynamic hand gestures, and it achieves 75% accuracy in detecting 11 different grasp types.

Preliminary tests of the device showed that it’s possible to use the system for smart device control and for use as a virtual mouse or keyboard, supporting the scientists' belief that the research development could advance development of controllers supporting bare-hand interactions.

The technique has applications in augmented and virtual reality devices, too, which often require the use of data gloves that can hinder movement or controllers with limited sensing capabilities. 

Future improvements to the camera system, such as higher frame rates and light sensitivity, will be needed for real-world use. The researchers said they further envision the incorporation of their device into a smart watch. 

The research was presented at the 33rd Association of Computer Machinery Symposium on User Interface Software and Technology.
Oct 2020
machine vision
Interpretation of an image of an object or scene through the use of optical noncontact sensing mechanisms for the purpose of obtaining information and/or controlling machines or processes.
Research & Technologycamerasmachine visionvirtual realityARVRgesture detectionGesture Recognitiongesture recognition systemsgesture controlgestureimagingsmart devicesTokyo Institute of TechnologycollaborationUniversity of St AndrewsUniversity of New South WalesCarnegie Mellon UniversityThe News Wire

Submit a Feature Article Submit a Press Release
Terms & Conditions Privacy Policy About Us Contact Us
Facebook Twitter Instagram LinkedIn YouTube RSS
©2023 Photonics Media, 100 West St., Pittsfield, MA, 01201 USA, [email protected]

Photonics Media, Laurin Publishing
x We deliver – right to your inbox. Subscribe FREE to our newsletters.
We use cookies to improve user experience and analyze our website traffic as stated in our Privacy Policy. By using this website, you agree to the use of cookies unless you have disabled them.