NLP & LANGUAGE

Word Embedding

NLP & Language

Definition

A word embedding is a vector representation of a word that captures its semantic meaning and relationships with other words. Words with similar meanings have close vectors. Word2Vec and GloVe were among the first word embedding models. Today, contextual models (BERT, GPT) generate embeddings that vary based on the sentence context.

Related terms

AI Fundamentals

Embedding

An embedding is a numerical representation (vector) of text, an image, or other data that captures semantic meaning. Texts with similar meaning have embeddings that are close in vector space. This technique is fundamental for semantic search, recommendation systems, and RAG, enabling information retrieval by meaning rather than just keywords.

AI Fundamentals

Vector

In AI, a vector is an ordered list of numbers that represents a concept, document, or data point. Vector databases (such as Pinecone or Weaviate) efficiently store and search these vectors, allowing you to find content that is similar in meaning. They are at the heart of modern RAG systems and enterprise semantic search applications.

NLP & Language

BERT

BERT (Bidirectional Encoder Representations from Transformers) is a language model developed by Google that understands the context of a word by looking both left and right in the text. It is particularly effective for comprehension tasks such as classification, question answering, and semantic search. Many enterprise search systems use BERT behind the scenes.

EXPLORE

More terms in NLP & Language

NLP (Natural Language Processing)

NLP is the field of AI concerned with the interaction between computers and human language. It includes tasks such as sentiment analysis, entity extraction, machine translation, and text generation. For SMEs, NLP enables automating the analysis of emails, customer reviews, legal documents, and internal communications.

Sentiment Analysis

Sentiment analysis is the NLP technique that automatically determines the emotional tone of a text: positive, negative, or neutral. Companies use it to monitor customer reviews, analyze brand sentiment on social media, and quickly identify satisfaction issues. It can be applied to thousands of texts in seconds.

Named Entity Recognition (NER)

NER is an NLP technique that automatically identifies and classifies entities such as names of people, companies, locations, dates, and monetary amounts within a text. In business, it is used to extract key information from contracts, invoices, emails, and legal documents, saving hours of manual data entry work.

Tokenization

Tokenization is the process of splitting a text into smaller units (tokens) that the AI model can process. Different models use different strategies: some split by words, others by subwords. Understanding tokenization helps estimate API costs (calculated per token) and optimize prompts to stay within the context window limits.

BERT

Text Classification

Text classification is the task of automatically assigning one or more categories to a document. Practical applications include: routing support tickets by priority, cataloging emails by department, classifying accounting documents by type. Modern models achieve accuracy above 95% on many business classification tasks.

See all glossary terms →

Want to apply AI in your business?

Talk to us. The first call is free and no commitment.

Book a call