Book Image

Artificial Vision and Language Processing for Robotics

By : Álvaro Morena Alberola, Gonzalo Molina Gallego, Unai Garay Maestre
Book Image

Artificial Vision and Language Processing for Robotics

By: Álvaro Morena Alberola, Gonzalo Molina Gallego, Unai Garay Maestre

Overview of this book

Artificial Vision and Language Processing for Robotics begins by discussing the theory behind robots. You'll compare different methods used to work with robots and explore computer vision, its algorithms, and limits. You'll then learn how to control the robot with natural language processing commands. You'll study Word2Vec and GloVe embedding techniques, non-numeric data, recurrent neural network (RNNs), and their advanced models. You'll create a simple Word2Vec model with Keras, as well as build a convolutional neural network (CNN) and improve it with data augmentation and transfer learning. You'll study the ROS and build a conversational agent to manage your robot. You'll also integrate your agent with the ROS and convert an image to text and text to speech. You'll learn to build an object recognition system using a video. By the end of this book, you'll have the skills you need to build a functional application that can integrate with a ROS to extract useful information about your environment.
Table of Contents (12 chapters)
Artificial Vision and Language Processing for Robotics
Preface

Simulators


Simulators are very good tools for developing and testing robotics software. They make robotics affordable for everyone. Imagine that you are working on a robotics project, where you constantly have to test functionality improvements with your robot. It would require connecting the robot for each test, charging it many times, and moving it with you. All of this can be avoided with a simulator, which can be launched in your computer at any time; it can even simulate the nodes and topics generated by the robot. Do you know any simulator for working with robots?

We are going to use Gazebo, a simulator included in the ROS full installation. In fact, if you chose this option while installing it, you can write "gazebo" in a terminal and it will launch the simulator. The Gazebo interface is shown in Figure 6.4:

Figure 6.5: The Gazebo start point

The next step is to install and set up the robot that we are going to simulate. In this case, we will use a Turtlebot, a wheelie robot that is...