Embedding
What is Embedding
Converting information (or any arbitrary data) to vector data.
"my name is Sam" -> [0.2, 0.1, 0.01, ... -0.3]
Visualizing Embeddings
When you visualize the embeddings in a 3D graph, you can see the "clustering" of relevant information in a space.
This clustering shows a visual relevance of each data stored in vector by the distance between them.
Semantics
Co-occurrence matrix.
- represents the frequency with which pairs of words appear together in a given context.
- Analyzes relationships between elements.
Vector Search
Semantic search in vector database involves using vector representation of data to perform search and retrieval based on semantic meaning of the content rather than exact keyword matches.
Meaning of context is stored in the embeddings.
Vector search finds the meaning by searching the vector space (dimensions).
- does not require exact keyword matches.
Works with text, image, and audio.