Book Image

Intelligent Projects Using Python

By : Santanu Pattanayak
Book Image

Intelligent Projects Using Python

By: Santanu Pattanayak

Overview of this book

This book will be a perfect companion if you want to build insightful projects from leading AI domains using Python. The book covers detailed implementation of projects from all the core disciplines of AI. We start by covering the basics of how to create smart systems using machine learning and deep learning techniques. You will assimilate various neural network architectures such as CNN, RNN, LSTM, to solve critical new world challenges. You will learn to train a model to detect diabetic retinopathy conditions in the human eye and create an intelligent system for performing a video-to-text translation. You will use the transfer learning technique in the healthcare domain and implement style transfer using GANs. Later you will learn to build AI-based recommendation systems, a mobile app for sentiment analysis and a powerful chatbot for carrying customer services. You will implement AI techniques in the cybersecurity domain to generate Captchas. Later you will train and build autonomous vehicles to self-drive using reinforcement learning. You will be using libraries from the Python ecosystem such as TensorFlow, Keras and more to bring the core aspects of machine learning, deep learning, and AI. By the end of this book, you will be skilled to build your own smart models for tackling any kind of AI problems without any hassle.
Table of Contents (12 chapters)

Processing the labelled captions of the video

The corpus.csv file contains the description of the videos in the form of text captions (see Figure 5.5). A snippet of the data is shown in the following screenshot. We can remove a few [VideoID,Start,End] combination records and treat these as test files for evaluation later on:

Figure 5.5: A snapshot of the format of the captions file

The VideoID, Start and End columns combine to form the video name in the following format: VideoID_Start_End.avi. Based on the video name, the features from the convolutional neural network VGG16 has been stored as VideoID_Start_End.npy. Illustrated in the following code block is the function to process the text captions for the video and create the path cross reference to the video image features from VGG16:

def get_clean_caption_data(self,text_path,feat_path):
text_data = pd.read_csv(text_path...