In the previous chapter, we explored the opportunities that HoloLens opens up by being able to see everything you see; our exploration began by setting up and walking through the holographic DirectX 11 application template Microsoft has bundled in Visual Studio 2015 Update 3. We then walked through extending this application to detect and identify faces, and display associated metadata about the identified person the user was looking at.
In this chapter, we continue our exploration with how HoloLens can better assist people through a proof of concept example that continuously observes the world, identifying and tracking salient items that you (it) see. If the user happens to forget where an item is, they will be able to ask for assistance and be guided via a breadcrumb trail from the user to the item. For instance, imagine, if you will, a time when you have misplaced your keys and spent vast amounts of time searching for them. Now, imagine a...