This project can be divided into two sections: teleoperation using Leap Motion and streaming images to an Android phone to get a VR experience inside a VR headset. Before going on to discuss each design aspect, let's look at how we can interconnect these devices. The following diagram shows how the components are interconnected for this project:
You can see that each device (that is, the PC and Android phone) is connected to a Wi-Fi router, and the router has assigned an IP address to each device. Each device communicates using these IP addresses. You will see the importance of these addresses in the upcoming sections.
Next, we will examine how we can teleoperate a robot in ROS using Leap Motion. We will be controlling it while wearing the VR headset. This means that we don't need to press any keys...