Book Image

ROS Robotics Projects - Second Edition

By : Ramkumar Gandhinathan
Book Image

ROS Robotics Projects - Second Edition

By: Ramkumar Gandhinathan

Overview of this book

Nowadays, heavy industrial robots placed in workcells are being replaced by new age robots called cobots, which don't need workcells. They are used in manufacturing, retail, banks, energy, and healthcare, among other domains. One of the major reasons for this rapid growth in the robotics market is the introduction of an open source robotics framework called the Robot Operating System (ROS). This book covers projects in the latest ROS distribution, ROS Melodic Morenia with Ubuntu Bionic (18.04). Starting with the fundamentals, this updated edition of ROS Robotics Projects introduces you to ROS-2 and helps you understand how it is different from ROS-1. You'll be able to model and build an industrial mobile manipulator in ROS and simulate it in Gazebo 9. You'll then gain insights into handling complex robot applications using state machines and working with multiple robots at a time. This ROS book also introduces you to new and popular hardware such as Nvidia's Jetson Nano, Asus Tinker Board, and Beaglebone Black, and allows you to explore interfacing with ROS. You'll learn as you build interesting ROS projects such as self-driving cars, making use of deep learning, reinforcement learning, and other key AI concepts. By the end of the book, you'll have gained the confidence to build interesting and intricate projects with ROS.
Table of Contents (14 chapters)

Reinforcement Learning and Robotics

So far, we have been looking at how a robot or a group of robots can handle a certain application. We began by creating robots, defining links, and programming robots to handle tasks in an appropriate manner for a certain application. We also learned how to handle multiple such robots for that application. What if we gave our robots intelligence like a human being so that they can sense, think, and act by understanding the actions they carry out in an environment? This chapter deals with one of the most important topics of machine learning called reinforcement learning, which might pave the way for artificial intelligence-based robot solutions.

In this chapter, you will be introduced to reinforcement learning, its usage with robotics, the algorithms used (such as Q-learning and SARSA), ROS-based reinforcement learning packages, and examples...