Augmented reality is another great innovation in the computer world. This is a process where we can mix up the real-world data and computer-generated objects. It overlays computer images, video, audio, and other objects from computer screens onto real-time environments. The Kinect sensor will be used to obtain the player data by capturing depth information or skeleton information and positioning it in the application. For example, you could place a virtual hat on a player's head. You can just perform this by tracking the human skeleton and positioning one hat image based on the head joint position.
For a quick example of an augmented reality application, you can take a look at the Green Screen sample application available with the Kinect for Windows Developer Toolkit. The Green Screen application renders the player body over the background image by removing the live background pixels of the player index using depth data as shown in the following screenshot:
