Book Image

Kinect for Windows SDK Programming Guide

By : Abhijit Jana
Book Image

Kinect for Windows SDK Programming Guide

By: Abhijit Jana

Overview of this book

Kinect has been a game-changer in the world of motion games and applications since its first release. It has been touted as a controller for Microsoft Xbox but is much more than that. The developer version of Kinect, Kinect for Windows SDK, provides developers with the tools to develop applications that run on Windows. You can use this to develop applications that make interaction with your computer hands-free. This book focuses on developing applications using the Kinect for Windows SDK. It is a complete end to end solution using different features of Kinect for Windows SDK with step by step guidance. The book will also help you develop motion sensitive and speech recognition enabled applications. You will also learn about building application using multiple Kinects.The book begins with explaining the different components of Kinect and then moves into to the setting up the device and getting thedevelopment environment ready. You will be surprised at how quickly the book takes you through the details of Kinect APIs. You will use NUI to use the Kinect for Natural Inputs like skeleton tracking, sensing, speech recognizing. You will capture different types of stream, and images, handle stream event, and capture frame. Kinect device contains a motorized tilt to control sensor angles, you will learn how to adjust it automatically. The last part of the book teaches you how to build application using multiple Kinects and discuss how Kinect can be used to integrate with other devices such as Windows Phone and microcontroller.
Table of Contents (19 chapters)
Kinect for Windows SDK Programming Guide
Credits
About the Author
Acknowledgement
About the Reviewers
www.PacktPub.com
Preface
Index

Beginning with Microsoft Speech API (SAPI)


The Kinect SDK uses Microsoft Speech Library for speech recognition. The SDK Installer installs the Microsoft Kinect Speech Recognition Language Pack (En-US) along with all other required components.

The Speech Application Programming Interface (SAPI) works as a middleware and provides an interface between the application and speech recognition engine.

Note

While installing the SDK, you have to make sure you don't have any previous version of a speech language pack installed; if yes, then first uninstall it, otherwise the installation will not proceed.

Steps for building speech-enabled applications

To develop any speech-enabled application, you need to typically perform the following basic steps:

  1. Enable the Kinect audio source.

  2. Start capturing the audio data stream.

  3. Identify the speech recognizer.

  4. Define the grammar for the speech recognizer.

  5. Start the speech recognizer.

  6. Attach the speech audio source to the recognizer.

  7. Register the event handler for speech...