Book Image

Learning Microsoft Cognitive Services - Second Edition

By : Leif Larsen
Book Image

Learning Microsoft Cognitive Services - Second Edition

By: Leif Larsen

Overview of this book

Microsoft has revamped its Project Oxford to launch the all new Cognitive Services platform-a set of 30 APIs to add speech, vision, language, and knowledge capabilities to apps. This book will introduce you to 24 of the APIs released as part of Cognitive Services platform and show you how to leverage their capabilities. More importantly, you'll see how the power of these APIs can be combined to build real-world apps that have cognitive capabilities. The book is split into three sections: computer vision, speech recognition and language processing, and knowledge and search. You will be taken through the vision APIs at first as this is very visual, and not too complex. The next part revolves around speech and language, which are somewhat connected. The last part is about adding real-world intelligence to apps by connecting them to Knowledge and Search APIs. By the end of this book, you will be in a position to understand what Microsoft Cognitive Service can offer and how to use the different APIs.
Table of Contents (19 chapters)
Title Page
Credits
About the Author
About the Reviewer
www.PacktPub.com
Customer Feedback
Preface

Unlocking video insights using Video Indexer


The Video Indexer is a service that allows you to upload videos and gain insights from the videos. This insight can be used to make the videos (and by extension your content) more discoverable. It can also be used to improve engagement from the users.

General overview

Using artificial intelligence technologies, the Video Indexer enables you to extract a great deal of information. It can gain insights from the following list of features:

  • Audio transcript
  • Face tracking and identification
  • Speaker indexing
  • Visual-text recognition
  • Voice-activity detection
  • Scene detection
  • Keyframe extraction
  • Sentiment analysis
  • Translation
  • Visual content moderation
  • Keywords extraction
  • Annotations

Typical scenarios

There are a few typical scenarios where one might want to use Video Indexer:

  • Search: If you have a library of videos, you can use the insights gained to index each video. Indexing by spoken words or where two specific people were seen together can provide a much better search...