-
Book Overview & Buying
-
Table Of Contents
RAG from First Principles
By :
Embedding is one of the core technologies of large models. Embedding refers to the process of encoding external information. Without embedding technology, a large model would have no way to perceive the world, understand, or process knowledge. In order to manage the complexity of unstructured data, we apply embedding technology to convert data into numerical vectors so as to capture its fundamental features.
This section covered various aspects of embedding technology, from its origins to the latest developments, and provided many concrete practical examples to help learners understand and practice.
Currently, text embedding technology is already very mature. However, multi-modal unstructured data (such as images, audio, and video) come in various formats and carry rich underlying semantics.
In the future, the focus of embedding technology will be on the coordinated development of multi-modality (such as text, image, and audio/video, etc.). Through cross-modal...