Introduction to 3D Gestural Interfaces
Three-dimensional gestural interfaces provide a powerful and natural way to interact with computers for a variety of applications, including video games, training and simulation, mobile computing, and medicine. And with advances in commodity motion sensors and user-tracking technology, this interaction paradigm is becoming more commonplace in everyday computing activities. However, designing and accurately recognizing 3D gestures so they can be used reliably in these applications pose many challenges.
This course demystifies design and development of 3D gestural interfaces by describing the 3D gestural user-interface development pipeline in four sections:
• The latest strategies on how to collect raw 3D gesture data, including both passive and active tracking schemes for fingers, hands, and the whole body.
• How to accurately analyze this raw data to correctly recognize 3D gestures using both heuristic algorithms and machine learning, and guidelines for choosing the most appropriate classification strategies.
• The latest in 3D-gesture-recognition performance in terms of accuracy and gesture-set size, and how different applications are making use of 3D gestural interaction.
• A summary of important future research directions that are critical to improving 3D gestural interaction.
Welcome, Introduction, and Roadmap
Collecting Data for 3D Gesture Recognition
3D Gesture Recognition Techniques
3D Gesture Recognition Performance and Applications
University of Central Florida