Book Image

Learning Microsoft Cognitive Services - Third Edition

By : Leif Larsen
Book Image

Learning Microsoft Cognitive Services - Third Edition

By: Leif Larsen

Overview of this book

Microsoft Cognitive Services is a set of APIs for integrating artificial intelligence in your applications to solve logical business problems. If you’re new to developing applications with AI, Learning Microsoft Cognitive Services will give you a comprehensive introduction to Microsoft’s AI stack and get you up-to-speed in no time. The book introduces you to 24 APIs, including Emotion, Language, Vision, Speech, Knowledge, and Search. Using Visual Studio, you can develop applications with enhanced capabilities for image processing, speech recognition, text processing, and much more. Moving forward, you will work with datasets that enable your applications to process various data in the form of image, video, or text. By the end of the book, you’ll be able to confidently explore Cognitive Services APIs for building intelligent applications that can be deployed for real-world business uses.

Related Content you might be interested in

Current Title:

Small book image
Learning Microsoft Cognitive Services - Third Edition
Leif Larsen
Sep, 2018 | 312 pages
Small book image
Hands-On Machine Learning with Azure
Jen Stirrup | Thomas K Abraham | Parashar Shah | Anindita Basak | Lauri Lehman
Oct, 2018 | 340 pages
Small book image
Building Bots with Microsoft Bot Framework
Kishore Gaddam
May, 2017 | 424 pages
Table of Contents (17 chapters)
Learning Microsoft Cognitive Services - Third Edition
Learning Microsoft Cognitive Services - Third Edition
Contributors
Contributors
Acknowledgments
Acknowledgments
Preface
Preface
Free Chapter
1
Getting Started with Microsoft Cognitive Services
Getting Started with Microsoft Cognitive Services
Cognitive Services in action for fun and life-changing purposes
Setting up the boilerplate code
Detecting faces with the Face API
An overview of different APIs
Getting feedback on detected faces
Summary
2
Analyzing Images to Recognize a Face
Analyzing Images to Recognize a Face
Analyze an image using the Computer Vision API
Diving deep into the Face API
Adding identification to our smart-house application
Knowing your mood using the Face API
Automatically moderating user content
Building your own image classifiers
Summary
3
Analyzing Videos
Analyzing Videos
Diving into Video Indexer
Unlocking video insights using Video Indexer
Summary
4
Letting Applications Understand Commands
Letting Applications Understand Commands
Creating language-understanding models
Training a model
Summary
5
Speaking with Your Application
Speaking with Your Application
Converting text to audio and vice versa
Knowing who is speaking
Verifying a person through speech
Customizing speech recognition
Translating speech on the fly
Summary
6
Understanding Text
Understanding Text
Setting up a common core
Correcting spelling errors
Extracting information through textual analysis
Translating text on the fly
Summary
7
Building Recommendation Systems for Businesses
Building Recommendation Systems for Businesses
Providing personalized recommendations
Summary
8
Querying Structured Data in a Natural Way
Querying Structured Data in a Natural Way
Tapping into academic content using the academic API
Interpreting natural language queries
Finding academic entities in query expressions
Calculating the distribution of attributes from academic entities
Entity attributes
Creating the backend using the Knowledge Exploration Service
Defining attributes
Adding data
Building the index
Understanding natural language
Local hosting and testing
Going for scale
Answering FAQs using QnA Maker
Creating a knowledge base from frequently asked questions
Training the model
Publishing the model
Summary
9
Adding Specialized Searches
Adding Specialized Searches
Searching the web using the smart-house application
Getting the news
Searching for images and videos
Helping the user with autosuggestions
Search commonalities
Searching for visual content using Bing Visual Search
Adding a custom search
Summary
10
Connecting the Pieces
Connecting the Pieces
Completing our smart-house application
Real-life applications using Microsoft Cognitive Services
Where to go from here
Summary
LUIS Entities
LUIS Entities
LUIS prebuilt entities
License Information
License Information
Video Frame Analyzer
OpenCvSharp3
Newtonsoft.Json
NAudio
Index
Index

Searching for images and videos

The Bing Image Search API and Bing Video Search API allow us to search directly for images or videos. These APIs should be used only if you need image or video content. There is a possibility that calling these APIs will affect performance and relevance negatively, and as such, one should aim to use the Bing Web Search API.

Note

If you have not already done so, sign up for the Bing Image Search API and the Bing Video Search API at https://portal.azure.com.

Using a common user interface

As we do not need image or video search in our smart-house application, we will go on to create a new project. Create this project using the MVVM template that we created in Chapter 1, Getting Started with Microsoft Cognitive Services.

These APIs do not come with any client packages. Like we did previously, we should really make these calls from the server-side application not the client application. In any case, we need to copy the BingWebRequest.cs file from the smart-house application...

Previous Section
End of Section 4
Next Section