Embedding

What is Embedding

Converting information (or any arbitrary data) to vector data.

"my name is Sam" -> [0.2, 0.1, 0.01, ... -0.3]

Visualizing Embeddings

When you visualize the embeddings in a 3D graph, you can see the "clustering" of relevant information in a space.

This clustering shows a visual relevance of each data stored in vector by the distance between them.

Semantics

Co-occurrence matrix.

  • represents the frequency with which pairs of words appear together in a given context.
  • Analyzes relationships between elements.

Vector Search

Semantic search in vector database involves using vector representation of data to perform search and retrieval based on semantic meaning of the content rather than exact keyword matches.

Meaning of context is stored in the embeddings.

Vector search finds the meaning by searching the vector space (dimensions).

  • does not require exact keyword matches.

Works with text, image, and audio.