ModelRefs / Embedding — AI Glossary
Embedding — AI Glossary
A dense vector representation of text, image, or audio that captures semantic meaning in a high-dimensional space.
Overview
Embedding models (text-embedding-3, BGE-M3, Voyage, Cohere Embed) map similar content to nearby points (typically 768–3072 dimensions). They power semantic search, clustering, classification, and RAG retrieval. Embedding quality is the ceiling of RAG retrieval quality.
Reference details
| Topic | rag |
|---|---|
| Last reviewed | 2026-06-24 |
Related terms
Example: Why cosine similarity, not keyword overlap
“How do I reset my password?” and “I forgot my login credentials” share almost no words — keyword search scores them near zero. Their embeddings sit close together, so cosine similarity is high and retrieval finds the right document. The same property is the failure mode: “cancel my subscription” and “renew my subscription” are also close, because they are about the same topic while meaning opposite things.
Commonly confused with
An embedding is not a summary and cannot be read back. It is a fixed-length vector, and nothing in it is human-inspectable. Similarity in embedding space means topical relatedness, which is not the same as relevance and definitely not the same as agreement.
When to use it
Reach for it when:
- Users phrase the same intent in many different ways
- You need clustering, deduplication or classification over free text
- Recall matters more than exact term matching
Reach for something else when:
- The query is an identifier — a SKU, error code or name — where lexical search wins outright
- Negation or opposites must be distinguished; embeddings are weak at this
- You need to explain to a user or auditor why a document was returned
Referenced by
This term is used by the following ModelRefs references:
Where this appears on ModelRefs
Continue your research
Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Embedding — AI Glossary.
Frequently asked questions
What is Embedding?
A dense vector representation of text, image, or audio that captures semantic meaning in a high-dimensional space.
What concepts are related to Embedding?
Closely related concepts include vector database, semantic search, rag, reranker.