Before we delve into the implementation of a SfM pipeline, let's revisit some key concepts that are an essential part of the process. The foremost class of theoretical topics in SfM is epipolar geometry (EG), the geometry of multiple views or MVG, which builds upon knowledge of image formation and camera calibration; however, we will only brush over these basic subjects. After we cover a few basics in EG, we will shortly discuss stereo reconstruction and look over subjects such as depth from disparity and triangulation. Other crucial topics in SfM, such as Robust Feature Matching, are more mechanical than theoretical, and we will cover them as we advance in coding the system. We intentionally leave out some very interesting topics, such as camera resectioning, PnP algorithms, and reconstruction factorization, since these are handled by the underlying sfm module and we need not invoke them, although functions to perform them do exist in OpenCV.
All of these subjects were...