Browse Library
Sign In Start Free Trial
Close icon Search icon
Account
Browse Library Sign In Start Free Trial

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Kinect for Windows SDK Programming Guide
  • Table Of Contents Toc
Kinect for Windows SDK Programming Guide

Kinect for Windows SDK Programming Guide

By : Abhijit Jana
4.6 (16)
Buy this Book
close
close
Kinect for Windows SDK Programming Guide

Kinect for Windows SDK Programming Guide

4.6 (16)
By: Abhijit Jana
Buy this Book

Overview of this book

Build motion-sensing applications with Microsoft\'s Kinect for Windows SDK quickly and easily with this book and ebook.
Table of Contents (19 chapters)
close
close
close
Kinect for Windows SDK Programming Guide
Icon
Kinect for Windows SDK Programming Guide
Credits
Icon
Credits
About the Author
Icon
About the Author
Acknowledgement
Icon
Acknowledgement
About the Reviewers
Icon
About the Reviewers
www.PacktPub.com
Icon
www.PacktPub.com
Preface
Icon
Preface
Lock Free Chapter
1
Understanding the Kinect Device
Icon
Understanding the Kinect Device
Icon
Components of Kinect for Windows
Icon
Kinect for Windows versus Kinect for Xbox
Icon
Where can you use Kinect
Icon
Summary
2
Getting Started
Icon
Getting Started
Icon
System requirements for the Kinect for Windows SDK
Icon
Evaluation of the Kinect for Windows SDK
Icon
Downloading the SDK and the Developer Toolkit
Icon
Installing Kinect for Windows SDK
Icon
Testing your device
Icon
Looking inside the Kinect SDK
Icon
Features of the Kinect for Windows SDK
Icon
The Kinect for Windows Developer Toolkit
Icon
Making your development setup ready
Icon
The Coding4Fun Kinect Toolkit
Icon
Summary
3
Starting to Build Kinect Applications
Icon
Starting to Build Kinect Applications
Icon
How applications interact with the Kinect sensor
Icon
Kinect Info Box – your first Kinect application
Icon
Dealing with the Kinect status
Icon
Summary
4
Getting the Most out of Kinect Camera
Icon
Getting the Most out of Kinect Camera
Icon
Understanding the Kinect image stream
Icon
Different ways of retrieving the color stream from Kinect
Icon
KinectCam – a Kinect camera application
Icon
Enabling the color stream channel
Icon
Looking inside color image stream helpers
Icon
Capturing frames on demand
Icon
Extending the KinectCam
Icon
Applying more effects to the camera
Icon
Seeing in low light
Icon
Making your application perform better
Icon
Using the Coding4Fun toolkit
Icon
Summary
5
The Depth Data – Making Things Happen
Icon
The Depth Data – Making Things Happen
Icon
Understanding the depth data stream
Icon
Capturing and processing depth data
Icon
Looking inside depth image stream helpers
Icon
Depth data and distance
Icon
Working with depth range
Icon
Depth data distribution
Icon
Player index with depth data
Icon
Getting the depth and player index automatically
Icon
A 3D view of depth data
Icon
Summary
6
Human Skeleton Tracking
Icon
Human Skeleton Tracking
Icon
How skeleton tracking works
Icon
Skeleton tracking with the Kinect SDK
Icon
Start tracking skeleton joints
Icon
Flow – capturing skeleton data
Icon
An intrusion detector camera application
Icon
Looking inside skeleton stream helpers
Icon
Skeleton-tracking mode
Icon
Skeleton tracking in near mode
Icon
The Skeleton
Icon
Choosing which skeleton to track
Icon
The building blocks – Joints and JointCollection
Icon
Steps to be followed for joint tracking
Icon
Create your own joints data point
Icon
Bones – connecting joints
Icon
Adjusting the Kinect sensor automatically and giving live feedback to users
Icon
Skeleton smoothing – soften the skeleton's movement
Icon
Skeleton space transformation
Icon
The Advanced Skeleton Viewer application
Icon
Debugging the applications
Icon
Getting data frames together
Icon
Summary
7
Using Kinect's Microphone Array
Icon
Using Kinect's Microphone Array
Icon
Verifying the Kinect audio configuration
Icon
Using the Kinect microphone array with your computer
Icon
The Kinect SDK architecture for Audio
Icon
Kinect microphone array
Icon
Audio signal processing in Kinect
Icon
Taking control over the microphone array
Icon
Kinect sound recorder – capturing Kinect audio data
Icon
Processing the audio data
Icon
Sound source localization
Icon
Summary
8
Speech Recognition
chevron up
Icon
Speech Recognition
Icon
How speech recognition works
Icon
Using Kinect with your Windows PC speech recognition
Icon
Beginning with Microsoft Speech API (SAPI)
Icon
Draw What I Want – a speech-enabled application
Icon
Summary
9
Building Gesture-controlled Applications
Icon
Building Gesture-controlled Applications
Icon
What is a gesture
Icon
Approaches for gesture recognition
Icon
Basic gesture recognition
Icon
Algorithmic gesture recognition
Icon
Weighted network gesture recognition
Icon
Template-based gesture recognition
Icon
Building gesture-enabled controls
Icon
The Basic Interaction – a WPF application
Icon
Key things to remember
Icon
Summary
10
Developing Applications Using Multiple Kinects
Icon
Developing Applications Using Multiple Kinects
Icon
Setting up the environment for multiple Kinects
Icon
Multiple Kinects – how to reduce interference
Icon
Detecting multiple Kinects
Icon
Developing an application with multiple Kinects
Icon
Controlling multiple sensor status changes
Icon
Handling a failover scenario using Kinects
Icon
Challenges faced in developing applications using multiple Kinects
Icon
Applications where multiple Kinects can be used
Icon
Summary
11
Putting Things Together
Icon
Putting Things Together
Icon
Taking Kinect to the Cloud
Icon
Remotely using the Kinect with Windows Phone
Icon
Using Kinect with a Netduino microcontroller
Icon
Augmented reality applications
Icon
Working with face tracking
Icon
Working with XNA and a 3D avatar
Icon
Summary
1
Index
Icon
Index

Chapter 8. Speech Recognition

One of the key aspects of Natural User Interface (NUI) is speech recognition. The speech recognition application allows users to say any command in front of the microphone, and on the other side the computer executes a certain action depending on the recognized command. The Kinect microphone array works as an excellent input device for speech-enabled applications. This provides much better quality in audio capturing compared to a single microphone by providing noise suppression, echo cancelation, and by listening to a particular direction with the help of sound source localization.

In the previous chapter, you have seen how the Kinect SDK interacts with the microphone array and you can build an application by capturing the audio stream. While the KinectAudioSource class is envisioned primarily for streaming and processing audio, combining it with the SpeechRecognitionEngine class actually shows the power of using a Kinect microphone array.

In this chapter, you...

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Kinect for Windows SDK Programming Guide
End of Section 8
Next Section
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected
Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful
Order Page Read Now

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon