-
Book Overview & Buying
-
Table Of Contents
RAG from First Principles
By :
If embedding technology is regarded as text representation learning, then vector storage technology involves processes such as indexing, saving, and querying vectors. Embeddings are responsible for forming and transmitting the “neural medium” by encoding external information, converting input information into understandable and processable vector representations. The vector database, on the other hand, is like the hippocampus, storing and organizing vectorized information in a complex semantic space and enabling efficient memory retrieval when needed.
By using embedding technology, an article is converted into a series of numbers; by using vector storage technology, we can quickly find the most relevant one from billions of vectors. This technology focuses on optimizing this process to achieve faster, more accurate, and more resource-efficient results.
Figure 4.1: Overview of embedding approaches, including common embedding models, sparse...