Book Image

Artificial Vision and Language Processing for Robotics

By : Álvaro Morena Alberola, Gonzalo Molina Gallego, Unai Garay Maestre
Book Image

Artificial Vision and Language Processing for Robotics

By: Álvaro Morena Alberola, Gonzalo Molina Gallego, Unai Garay Maestre

Overview of this book

Artificial Vision and Language Processing for Robotics begins by discussing the theory behind robots. You'll compare different methods used to work with robots and explore computer vision, its algorithms, and limits. You'll then learn how to control the robot with natural language processing commands. You'll study Word2Vec and GloVe embedding techniques, non-numeric data, recurrent neural network (RNNs), and their advanced models. You'll create a simple Word2Vec model with Keras, as well as build a convolutional neural network (CNN) and improve it with data augmentation and transfer learning. You'll study the ROS and build a conversational agent to manage your robot. You'll also integrate your agent with the ROS and convert an image to text and text to speech. You'll learn to build an object recognition system using a video. By the end of this book, you'll have the skills you need to build a functional application that can integrate with a ROS to extract useful information about your environment.
Table of Contents (12 chapters)
Artificial Vision and Language Processing for Robotics
Preface

Introduction


Developing software for robots is not as easy as developing any other type of software. To build robots, you need methods and functions that enable you to access sensor information, control robot parts, and connect with the robot. These methods and functions are present in ROS, making it easier to build a virtual robot.

ROS is a framework that is compatible with Ubuntu (Linux) for writing robot software. It is a set of libraries and tools through which it is possible to build and create various robotic behaviors. One of the most interesting features about this framework is that the developed code can be adapted for any other robot. ROS also gives you a chance to work on several machines simultaneously; for instance, if you want to use a robot to collect apples, you can use a computer to obtain the camera information of the apple and process it, another machine to launch the movement that commands the robot, and finally the robot will pick up the apple. By following this workflow...