Book Image

3D Deep Learning with Python

By : Xudong Ma, Vishakh Hegde, Lilit Yolyan
Book Image

3D Deep Learning with Python

By: Xudong Ma, Vishakh Hegde, Lilit Yolyan

Overview of this book

With this hands-on guide to 3D deep learning, developers working with 3D computer vision will be able to put their knowledge to work and get up and running in no time. Complete with step-by-step explanations of essential concepts and practical examples, this book lets you explore and gain a thorough understanding of state-of-the-art 3D deep learning. You’ll see how to use PyTorch3D for basic 3D mesh and point cloud data processing, including loading and saving ply and obj files, projecting 3D points into camera coordination using perspective camera models or orthographic camera models, rendering point clouds and meshes to images, and much more. As you implement some of the latest 3D deep learning algorithms, such as differential rendering, Nerf, synsin, and mesh RCNN, you’ll realize how coding for these deep learning models becomes easier using the PyTorch3D library. By the end of this deep learning book, you’ll be ready to implement your own 3D deep learning models confidently.
Table of Contents (16 chapters)
1
PART 1: 3D Data Processing Basics
4
PART 2: 3D Deep Learning Using PyTorch3D
9
PART 3: State-of-the-art 3D Deep Learning Using PyTorch3D

PART 2: 3D Deep Learning Using PyTorch3D

This part will cover some basic 3D computer vision processing using PyTorch3D. Implementing these 3D computer vision algorithms may become easier by using PyTorch3D. The readers will get a lot of hands-on experience working with meshes, point clouds, and fitting from images.

This part includes the following chapters:

  • Chapter 3, Fitting Deformable Mesh Models to Raw Point Clouds
  • Chapter 4, Learning Object Pose Detection and Tracking by Differentiable Rendering
  • Chapter 5, Understanding Differentiable Volumetric Rendering
  • Chapter 6, Exploring Neural Radiance Fields (NeRF)