OpenNI Cookbook

OpenNI Cookbook

By : Soroush Falahati

Buy this Book

OpenNI Cookbook

By: Soroush Falahati

Buy this Book

Overview of this book

The release of Microsoft Kinect, then PrimeSense Sensor, and Asus Xtion opened new doors for developers to interact with users, re-design their application’s UI, and make them environment (context) aware. For this purpose, developers need a good framework which provides a complete application programming interface (API), and OpenNI is the first choice in this field. This book introduces the new version of OpenNI. "OpenNI Cookbook" will show you how to start developing a Natural Interaction UI for your applications or games with high level APIs and at the same time access RAW data from different sensors of different hardware supported by OpenNI using low level APIs. It also deals with expanding OpenNI by writing new modules and expanding applications using different OpenNI compatible middleware, including NITE. "OpenNI Cookbook" favors practical examples over plain theory, giving you a more hands-on experience to help you learn. OpenNI Cookbook starts with information about installing devices and retrieving RAW data from them, and then shows how to use this data in applications. You will learn how to access a device or how to read data from it and show them using OpenGL, or use middleware (especially NITE) to track and recognize users, hands, and guess the skeleton of a person in front of a device, all through examples.You also learn about more advanced aspects such as how to write a simple module or middleware for OpenNI itself. "OpenNI Cookbook" shows you how to start and experiment with both NIUI designs and OpenNI itself using examples.

OpenNI Cookbook

Credits

About the Author

About the Reviewers

www.PacktPub.com

Preface

Free Chapter

Getting Started

Introduction

Downloading and installing OpenNI

Downloading and installing NiTE

Downloading and installing the Microsoft Kinect SDK

Connecting Asus Xtion and PrimeSense sensors

Connecting Microsoft Kinect

OpenNI and C++

Introduction

Creating a project in Visual Studio 2010

OpenNI class and error handling

Enumerating a list of connected devices

Accessing video streams (depth/IR/RGB) and configuring them

Retrieving a list of supported video modes for depth stream

Selecting a specific device for accessing depth stream

Listening to the device connect and disconnect events

Opening an already recorded file (ONI file) instead of a device

Using Low-level Data

Introduction

Configuring Visual Studio 2010 to use OpenGL

Initializing and preparing OpenGL

Reading and showing a frame from the image sensor (color/IR)

Reading and showing a frame from the depth sensor

Controlling the player when opening a device from file

Recording streams to file (ONI file)

Event-based reading of data

More about Low-level Outputs

Introduction

Cropping and mirroring frames right from the buffer

Syncing image and depth sensors to read new frames from both streams at the same time

Overlaying the depth frame over the image frame

Converting the depth unit to millimetre

Retrieving the color of the nearest point without depth over color registration

Enabling/disabling auto exposure and auto white balance

NiTE and User Tracking

Introduction

Getting a list of all the active users

Identifying and coloring users' pixels in depth map

Reading users' bounding boxes and center of mass

Event-based reading of users' data

NiTE and Hand Tracking

Introduction

Recognizing predefined hand gestures

Tracking hands

Event-based reading of hands' data

Working sample for controlling the mouse by hand

NiTE and Skeleton Tracking

Introduction

Detecting a user's pose

Getting a user's skeleton joints and displaying their position in the depth map

Designing a simple pong game using skeleton tracking

Index

Customer Reviews

5 star

4 star

3 star

2 star

1 star

Downloading and installing NiTE

If you want to use high-level outputs and some advanced tracking and recognition features of NiTE, you need to install it as well. NiTE is a middleware based on the OpenNI framework and needs to be installed after it.

Getting ready

Before installing NiTE, you need to have OpenNI installed using the Downloading and installing OpenNI recipe in this chapter.

How to do it...

Before downloading NiTE, you need to register yourself in OpenNI.org. For doing so, please open your browser and navigate to www.openni.org/my-profile. Now fill all the fields and click on the Submit button:
After the registration, if everything goes fine, you'll be able to download NiTE. Open your browser and navigate to www.openni.org/files/nite:
Download NiTE using the big DOWNLOAD button at the upper-right corner and then select your desired version of it:
Open the downloaded file; it is usually a ZIP file that can be opened by different programs (including but not limited to WinZip, WinRar, 7Zip, and so on) and even Windows Explorer. Then run/open the actual installer from within the zipped archive:
Read and accept the license arguments, then click on Next and then on Install in the installer dialog:
Wait for the installation to complete and, at the end of the installation, click on Finish and you are done: