3D Hand Tracking

The purpose of this project is to create a library that will allow its users to control 3D applications by using one or both of their hands.

The final product could easily be incorporated into 3D applications, each customized to utilize a set of poses. Even though off-the-shelf motion capture gloves have reached lower prices in recent years, they are still expensive for home users. The algorithm suggested is based only on a single webcam combined with coded palm and fingers. Users should be able to code one or more of the fingers. One webcam is still somewhat constraining as two should ideally be used for 3D mapping of the hand, but by additionally using palm and finger coding we can greatly improve precision and, most importantly, reduce the processing power required for feasible real-time 3D interaction. The first time this idea was published was in: DORNER, B. 1994. Chasing the Colour Glove: Visual Hand Tracking. Master’s thesis, Simon Fraser University. Related work: Robert Y. Wang and Jovan Popovic, Real-Time Hand-Tracking with a Color Glove, ACM Transaction on Graphics (SIGGRAPH 2009), 28(3), August 2009.

Publications or Reports

  • J. Fredriksson, S. B. Ryen, and M. Fjeld. 2008. Real-Time 3D Hand-Computer Interaction: Optimization and Complexity Reduction. (NordiCHI 2008). PP. 133-141.   
  • F. Duca, J. Fredriksson, and M. Fjeld. 2007. 3D Hand Navigation. In Proceedings Workshop at the IEEE Virtual Reality 2007 Conference: Trends and Issues in Tracking for Virtual Environments. PP. 1-5.   
Project Status

No current activity

Former workers: Florin Duca, Morten Fjeld, Jonas Fredriksson, Sven Berg Ryen

Future plans: No activity currently planned