Artificial intelligence (AI) changes fast, and its vocabulary changes with it. Some older terms still matter, while others have faded as large language models, multimodal systems, AI agents, and reasoning models have become more common.
This glossary explains the AI terms beginners are most likely to see in articles, product pages, research summaries, developer tools, and everyday AI discussions.
The list includes classic machine learning concepts, core deep learning terms, and newer vocabulary from generative AI, agentic AI, AI coding tools, retrieval systems, and model evaluation.
Each definition uses plain language so you can understand the term without needing a computer science background.
Latest Update: May 13, 2026
Essential AI Terms Beginners Should Know First
If you are new to artificial intelligence, start with the terms that appear most often in AI tools, news, and product documentation: AI, machine learning, deep learning, neural networks, LLMs, generative AI, prompts, tokens, context window, embeddings, RAG, fine-tuning, AI agents, tool calling, hallucination, grounding, multimodal AI, reasoning models, inference, and model evaluation.
These concepts explain most of what beginners need to understand before moving into more technical AI terminology. The full A-Z glossary below expands from those core ideas into model training, safety, computer vision, natural language processing, agent workflows, and modern generative AI systems.
How This AI Glossary Is Organized
This AI glossary is organized alphabetically so you can scan it like a dictionary. Each entry gives a short definition first, with enough context to understand how the term is used in real AI products, research papers, tutorials, and developer tools.
A
- Activation Function: Math functions like sigmoid, ReLU applied to neurons to introduce non-linearity into neural networks.
- Adversarial Attack: Carefully constructed inputs meant to fool AI systems by exploiting vulnerabilities.
- Adversarial Robustness: The ability of AI systems to withstand adversarial attacks.
- Agent: An AI system that can pursue a goal by planning steps, using tools, observing results, and adjusting its next action.
- Agent2Agent Protocol (A2A): An open protocol for helping AI agents communicate, exchange tasks, and work across different platforms or vendors.
- Agentic AI / AI Agent Systems: AI systems, often powered by LLMs, that can plan, use tools, complete multi-step tasks, and operate with some autonomy toward a defined goal.
- AI Inference: The phase where a trained model generates outputs from new inputs, as opposed to training.
- Agent Orchestration: The process of coordinating multiple AI agents, tools, and workflows so they can collaborate toward a shared goal.
- Agent Memory: Stored context that lets an AI agent remember user preferences, past actions, project details, or task history across steps or sessions.
- Agentic Workflow: A workflow where one or more AI agents choose actions, call tools, and check results instead of following only a fixed script.
- AGI (Artificial General Intelligence): A hypothetical AI system that could learn, reason, and perform a wide range of cognitive tasks at or above human level.
- AI Ethics: The study and practice of building AI systems that respect fairness, privacy, accountability, transparency, and human well-being.
- AI Alignment: The effort to make AI systems behave according to intended goals, human values, and safety constraints.
- AIGC (AI-Generated Content): Text, images, audio, video, code, or other content created with AI systems.
- Algorithm: A set of rules or steps that a computer follows to complete a task.
- AI Governance: Policies, controls, and review processes used to manage AI risk, compliance, accountability, and responsible deployment.
- AI Red Teaming: Testing an AI system with adversarial prompts, edge cases, and misuse scenarios to find safety, security, and reliability problems.
- AI Safety: Research and engineering focused on reducing harmful, unreliable, or unintended behavior from AI systems.
- Alignment Tax: The possible trade-off between raw model capability, latency, or flexibility and the safeguards added through alignment or policy tuning.
- AlphaGo: A DeepMind system that showed major progress in reinforcement learning by defeating elite Go players, including Lee Sedol in 2016.
- ANI (Artificial Narrow Intelligence): AI systems that are designed and trained to perform a specific task without possessing the general problem-solving abilities that a human has. Unlike Artificial General Intelligence (AGI), which would have the capability to understand, learn, and apply knowledge in different domains, ANI focuses on a narrow, well-defined task.
- Artificial Intelligence: The field of building computer systems that can perform tasks associated with intelligence, such as perception, language understanding, reasoning, learning, and decision-making.
- Artificial Neural Network (ANN): A computing system inspired by the human brain’s neural networks, used for processing complex patterns of information.
- ASI (Artificial Superintelligence): A theoretical form of AI that would surpass human ability across nearly all economically or intellectually important tasks.
- Attention Layers: Parts of a neural network that learn which tokens, pixels, or features matter most for a task.
- Attention Mechanism: A component of neural networks that allows them to focus on specific parts of the input.
- Autoencoder: A type of neural network used for unsupervised learning and dimensionality reduction.
- Autonomous: Able to act with limited human direction after receiving a goal, instruction, or policy.
- Azure Machine Learning: A cloud-based service by Microsoft for building, training, and deploying machine learning models.
B
- Backpropagation: Algorithm used to calculate loss and adjust weights in neural networks.
- Batch Normalization: Normalizing activations throughout a neural network to stabilize training.
- Bayesian Networks: Probabilistic model representing variables and conditional dependencies via graph.
- Benchmark: A standardized test or dataset used to compare model performance on tasks such as reasoning, coding, math, language understanding, or image recognition.
- BERT (Bidirectional Encoder Representations from Transformers): A Google language model architecture that helped popularize transformer-based pretraining for search and natural language understanding.
- Bias: Systematic error in data, model design, training, or deployment that can lead to unfair or inaccurate results.
- Big Data: Extremely large data sets analyzed computationally to reveal patterns.
- Black-Box Model: A model whose internal reasoning or decision process is difficult for humans to inspect or explain.
C
- Chatbot: A software application that responds to users in conversational language, often through rules, retrieval, or generative AI.
- ChatGPT: OpenAI’s AI assistant product for conversation, writing, coding, research, image generation, voice, and tool-based tasks.
- Classification: Categorizing input data among a set of target classes or categories.
- Claude: An AI assistant and model family developed by Anthropic.
- Coding Agent: An AI agent designed to inspect code, edit files, run tests, debug errors, and help complete software development tasks.
- Clustering: Grouping data points based on similarity, often without labeled examples.
- CNN (Convolutional Neural Network): A type of deep learning neural network that is particularly well-suited for image recognition and classification tasks.
- Compute Budget: A constraint on how much computational resource (time, tokens, FLOPs) a model or agent can use per task.
- Computer-Using Agent: An AI agent that can interact with a graphical user interface by viewing a screen, clicking, typing, and navigating software.
- Computer Vision: AI methods for processing, analyzing, and understanding images, video, and other visual data.
- Connectionism: A framework for understanding intelligence as the emergent property of interconnected networks of simple processing units.
- Context Caching: A technique to reduce costs and latency by storing and reusing previously processed input tokens (like long documents or codebases), so the model doesn’t need to re-read them for every new prompt.
- Context Engineering: The practice of structuring prompts, memory, tools, and retrieved data to guide an AI system’s behavior more reliably.
- Context Rot: The decline in model quality that can happen when a long context window contains too much irrelevant, conflicting, or poorly organized information.
- Context Window: The maximum amount of text, code, images, or other tokens that a model can process at one time.
- Constitutional AI: An alignment method where a model is trained or refined using a written set of principles that guide safe and helpful behavior.
- Copilot: An AI assistant built into a software product to help users write, search, summarize, code, or complete tasks in context.
- CoT (Chain-of-Thought): A prompting and training pattern that encourages a model to solve a problem through intermediate reasoning steps, even when those steps are not shown to the user.
- Cross-modal Generalization: The ability to apply knowledge learned in one sensory modality to another modality.
- CV (Computer Vision): Extract useful information from images and videos, such as identifying objects and people, tracking their movement, and understanding their interactions with the environment.
D
- Data Augmentation: Artificially increase the size of a training dataset by creating modified versions of existing data.
- Data Leakage: When information leaks from test data to training data, causing overfitting.
- Data Mining: Extracting insights from large data sets to uncover patterns.
- DALL·E: OpenAI’s earlier text-to-image model family, best known for generating images from written prompts.
- Deep Learning: Neural networks with many layers that can extract high-level features from raw data.
- DeepMind: The AI research organization now known as Google DeepMind, known for systems such as AlphaGo, AlphaFold, and Gemini.
- Decision Tree: A flowchart-like structure in which each internal node represents a test on an attribute, each branch represents the outcome of the test, and each leaf node represents a class label.
- Deliberate Reasoning: A reasoning approach where models spend additional computation time to evaluate intermediate steps before producing a final answer.
- Diffusion Models: A type of generative model that can be used to generate realistic images, text, and other types of data.
- Diffusion Transformer (DiT): A hybrid architecture that combines diffusion models with transformer-based structures, commonly used in image and video generation.
- Direct Preference Optimization (DPO): A model alignment method that trains a model from preference data without requiring a separate reward model.
- Dimensionality Reduction: Reducing number of variables considered, simplifying data.
- Distributed Computing: Splitting computations across multiple processors to parallelize workload.
- Double Descent: A phenomenon in machine learning where increasing the number of model parameters first leads to a decrease in performance, and then to an increase in performance.
E
- Edge AI: Running AI models directly on local devices instead of relying only on remote cloud servers.
- Embedding: A numerical representation of text, images, audio, or other data that captures meaning or similarity in vector form.
- Embedding Model: A specialized model used only to convert text, images, or other data into vector representations.
- Embedding Space: The mathematical space where embeddings are placed, allowing similar items to appear closer together.
- End-to-end learning: A machine learning approach where a single model is trained to perform a task from input to output without any intermediate steps.
- Ensemble Models: Combining multiple models to produce predictions that are more robust.
- Epoch: One cycle through the full training dataset in machine learning.
- Evolutionary Algorithm: Algorithms that use mechanisms inspired by biological evolution, such as reproduction, mutation, and selection.
- Evals: Tests used to measure whether an AI model or system performs well on target tasks, follows instructions, and avoids known failure modes.
- Expert System: An older AI approach that uses human-written rules and domain knowledge to make decisions in a narrow field.
- Explainable AI (XAI): Methods that make AI decisions easier for humans to inspect, understand, and challenge.
F
- Facial Recognition: Identifying or verifying individuals by analyzing facial characteristics.
- False Positive: Incorrect classification of an input as positive for the condition being tested.
- Feature Engineering: Transforming raw data into features that better represent patterns.
- Federated Learning: Training algorithm distributed across decentralized edge devices.
- Few-shot Learning: A machine learning approach that enables models to learn new tasks from a very small number of examples.
- Fine-tuning: Adapting a pretrained model on a smaller, targeted dataset so it performs better for a specific task, style, or domain.
- Fitting: The process of training a machine learning model on a dataset.
- Forward Propagation: The process of passing input data through a neural network to calculate an output.
- Foundation Model: A large model trained on broad data that can be adapted to many downstream tasks, including language, vision, audio, code, or multimodal work.
- Frontier Model: A highly capable model near the current state of the art, often used for advanced reasoning, coding, multimodal work, or agentic tasks.
- Function Calling: The ability of a model to request a structured call to an external tool, API, database, or application when a task requires it.
- Function Schema: A structured definition that describes how an AI model should call external tools or APIs.
- Fuzzy Logic: A computing approach based on “degrees of truth” rather than the usual true or false binary logic.
G
- GAN (Generative Adversarial Network): A generative model made of two competing neural networks: one creates outputs and the other judges whether they look real.
- Gemini: A series of multimodal models developed by Google DeepMind, designed to understand, operate across, and combine various types of information like text, code, images, audio, and video.
- Generalization Ability: The ability of a model to perform well on new data that it has never seen before.
- Generative AI: Artificial intelligence that can create new text, images, audio, video, code, or other media.
- Genetic Algorithm: A search heuristic inspired by the process of natural selection.
- GPT (Generative Pre-trained Transformer): A series of language representation models by OpenAI.
- Gradient Boosting: Successively training weak learners to improve predictive performance.
- Gradient Descent: An optimization algorithm commonly used to train machine learning models. It works by iteratively adjusting the parameters of the model in the direction of the negative gradient of the loss function.
- Graphical Model: A type of probabilistic model that uses a graph to represent and map out dependencies.
- GraphRAG: An evolution of RAG that uses Knowledge Graphs to structure retrieved information. It helps the AI understand the “big picture” and relationships between concepts, not just keyword matching.
- Grok: A conversational AI assistant and model family developed by xAI.
- Groq (LPU): A company and hardware platform focused on fast AI inference using Language Processing Units.
- Grounding: The process of tying model outputs to verified data sources, retrieved documents, tool results, or real-world references.
- Guardrails: Rules, filters, validation steps, or system controls that limit unsafe, off-topic, or unreliable AI behavior.
H
- Hallucination: An AI output that sounds plausible but is false, unsupported, or inconsistent with the provided context.
- Hardware: Physical computer machinery needed to run machine learning algorithms.
- Heuristic: An approach to problem solving relying on practical methods and experience.
- Hidden Layer: A layer of neurons that is located between the input layer and the output layer.
- Hugging Face: A company known for its Transformers library, which provides state-of-the-art general-purpose architectures for natural language understanding and generation.
- Human-in-the-Loop (HITL): A system design where people review, approve, correct, or guide AI outputs during training or deployment.
- Hypernetworks: A type of neural network architecture where one neural network generates the weights for another network, enabling dynamic adjustments of network architecture and functionality.
- Hyperparameter Tuning: Optimizing hyperparameters to improve model performance on data.
- Hypothesis: An initial assumption made about the data.
I
- IBM Watson: A suite of AI tools and applications by IBM.
- ImageNet: A large-scale dataset used for visual object recognition software research.
- Image Recognition: Identifying objects or features within images or videos.
- Incremental Learning: A method where the learning model is capable of learning continuously, adapting to new data without forgetting its previously learned knowledge.
- Inference: Applying a trained machine learning model to make predictions on new data.
- Inference-Time Scaling: Improving model performance by increasing computation during inference rather than increasing model size.
- Input Token: A token supplied to a model as part of the prompt, context, file, message, image, or tool result.
- Information Retrieval: The process of obtaining information from a database using a query.
- Instance: A single data point or example in a dataset.
- Instruction Tuning: A technique for fine-tuning large language models (LLMs) to follow instructions more accurately and comprehensively.
- Interpretability: Ability to explain why AI systems behave in certain ways.
J
- Julia: A high-level, high-performance programming language for technical computing, with syntax familiar to users of other technical computing environments.
- Jupyter Notebook: An open-source web application for interactive computing and data visualization.
- Joint Probability: The probability of two events happening at the same time.
- JSON (JavaScript Object Notation): A lightweight data-interchange format that’s easy for humans to read and write.
- Jailbreak: A prompt or interaction designed to bypass an AI system’s safety rules, policy constraints, or intended behavior.
K
- K-means Clustering: Unsupervised algorithm grouping data points into k clusters based on similarity.
- Kernel: A function used in the machine learning algorithm to map a lower-dimensional data into a higher-dimensional data.
- KNN (K-Nearest Neighbors): A simple, instance-based learning algorithm.
- Knowledge Distillation: Transferring the knowledge from a large, complex teacher model to a smaller, simpler student model.
- Knowledge Graph: Database of real-world entities and relationships between them.
- Knowledge Representation: The field of AI dedicated to representing information about the world in a form that a computer system can utilize to solve complex tasks such as diagnosing a medical condition or having a dialogue in natural language.
- KV Cache (Key-Value Cache): A memory optimization technique used in transformer inference to reuse previous attention computations.
L
- Latency: The time delay between a user request and the model’s response.
- Latent Variable: A variable that’s not directly observed but inferred from other variables.
- Lazy Learning: Algorithms that defer processing until needed, storing training data instead.
- Learning Rate: Determines the step size at each iteration while moving towards a minimum of the loss function.
- Lifelong Learning: The ability of an AI system to continuously learn and incorporate new knowledge over time, without forgetting or catastrophically interfering with previously learned skills and information.
- Llama: A family of open-weight AI models released by Meta.
- LLM (Large Language Model): A large neural network trained to process and generate language. Modern LLM-based systems may also work with code, images, audio, video, tools, and structured data.
- LLMOps: The practice of deploying, monitoring, evaluating, and improving LLM applications in production.
- Logistic Regression: Predictive modeling method suited for binary classification tasks.
- Long-Context Model: A language model designed to process very large context windows, often exceeding hundreds of thousands of tokens.
- LoRA (Low-Rank Adaptation): An efficient fine-tuning technique for large pre-trained models. It works by freezing the original model weights and injecting trainable, low-rank matrices into specific layers (e.g., attention layers of Transformers), significantly reducing the number of trainable parameters and computational cost for adaptation.
- Loss Function: A mathematical function that quantifies the difference between the predicted and actual values in a machine learning model.
- LSTM (Long Short-Term Memory): A type of recurrent neural network designed to handle sequential data and preserve information over time.
M
- Machine Learning: Algorithms that can learn from data to make predictions or decisions.
- Machine Translation: Automated translation of text or speech from one language to another.
- Maximum Entropy: A modeling principle that favors the probability distribution with the fewest extra assumptions beyond the known constraints.
- Markov Chain: A sequence of events in which the probability of each event depends only on the state attained in the previous event.
- Matrix Factorization: Decomposing a matrix into factors to discover latent features.
- MCP (Model Context Protocol): An open protocol that connects AI applications to external tools, data sources, and services through a standard interface.
- Memory: Stored information that an AI system can use later, such as user preferences, project history, retrieved facts, or prior task steps.
- Meta-learning: The idea that AI systems can learn how to learn.
- Midjourney: An AI image generation service developed by Midjourney, Inc.
- Mixtral: A family of sparse Mixture of Experts (SMoE) large language models, such as Mixtral 8x7B, known for their strong performance and efficiency, often outperforming larger dense models by selectively activating only a fraction of their parameters (“experts”) for any given input.
- Mixture of Agents (MoA): An architecture where multiple AI agents with different specializations collaborate to solve complex problems, each contributing their expertise to the overall solution.
- Mixture of Experts: A model architecture that routes each input or token to a small subset of specialized expert networks instead of using the whole model for every calculation.
- Model: A representation of a system to help understand and predict the system’s behavior.
- Model Collapse: A degenerative process where AI models trained on AI-generated data (synthetic data) eventually lose quality, diversity, and grasp of reality.
- Model Card: A document that describes a model’s intended use, training data, limitations, evaluation results, and safety considerations.
- Model Routing: Dynamically selecting which model or expert should handle a specific task or input.
- Model Spec: A written specification that defines how an AI model or assistant should behave, including priorities, refusals, safety rules, and response style.
- Model Weights: The learned numerical parameters inside a neural network that determine how it processes inputs and generates outputs.
- Multi-Agent System: A system where multiple agents coordinate, specialize, review, or compete to solve a task.
- Multimodal Chain-of-Thought: Extending chain-of-thought reasoning to work across multiple data modalities (text, images, audio), enabling more comprehensive problem-solving approaches.
- Multimodal LLM: A Large Language Model that can process and generate information from multiple types of data (modalities) simultaneously, such as text, images, audio, and video. It can understand relationships and context across these different data types.
- Multimodal Tokenization: The process of converting text, images, audio, or video into a unified token format.
N
- Natural Language Processing (NLP): Automating the analysis and generation of natural human language.
- Native Multimodality: A model design where text, images, audio, video, or other modalities are processed directly by the model rather than handled by separate add-on systems.
- NeRF: Creating photorealistic 3D models of objects and scenes from 2D images.
- Neural Architecture Search: Automating the design of neural network architectures.
- Neural Networks: Algorithms modeled loosely on the human brain’s neurons.
- Neuroevolution: A form of artificial intelligence that uses evolutionary algorithms to generate artificial neural networks, parameters, topology, and rules.
O
- Occam’s Razor: The problem solving principle that the simplest solution tends to be the best.
- On-Device AI: AI that runs locally on a phone, laptop, browser, or embedded device instead of sending every request to a cloud server.
- Open-Weight Model: A model whose trained weights are released for others to download, run, fine-tune, or inspect under a specific license.
- Optimization: Iteratively tuning parameters to minimize error and improve model performance.
- Orchestrator Agent: A supervisory agent responsible for task delegation, monitoring, and coordination among other agents.
- Outlier: A data point that’s significantly different from other data points.
- Output Token: A token generated by a model as part of its response.
- Overfitting: When a model fits the training data too closely but generalizes poorly.
- Ontology: A set of concepts and categories in a subject area that shows their properties and the relations between them.
P
- Perception: The process of interpreting sensory input such as images, audio, video, or environmental signals.
- Perceptron: Early and simple neural network model for binary classification tasks.
- PEFT (Parameter-Efficient Fine-Tuning): A family of fine-tuning methods that update only a small number of parameters instead of retraining a full model.
- Planning: The process of generating a sequence of actions to achieve a goal.
- Planning Module: A component in agent systems that decomposes goals into ordered steps.
- Post-training Alignment: Fine-tuning methods applied after pretraining to shape behavior, safety, and instruction-following.
- Precision: Fraction of results returned by a model that are relevant.
- Predictive Modeling: Using statistics to predict outcomes.
- Principal Component Analysis (PCA): A method used to emphasize variation and bring out strong patterns in a dataset.
- Probabilistic Modeling: Representing uncertainty and randomness to model real world data.
- Prompt: In AI, a prompt is a piece of text that provides instructions or guidance to an AI model. It can be used to tell the model what task to perform, what kind of output to generate, or what style or tone to use.
- Prompt Caching: A cost and latency optimization that lets a system reuse previously processed prompt or context tokens.
- Prompt Engineering: The practice of writing and refining instructions, examples, constraints, and context so an AI model produces a better response.
- Prompt Injection: An attack that places malicious or conflicting instructions inside user input, documents, webpages, or tool results to manipulate an AI system.
- Prompt Tuning: A parameter-efficient adaptation method that trains small prompt-like vectors while keeping most model weights fixed.
- PyTorch: An open-source machine learning framework originally developed by Facebook AI Research and now widely used for deep learning research and production.
Q
- Q-Learning: Reinforcement learning technique using a reward system.
- Quantization: Reducing numerical precision of model weights to improve inference speed and reduce memory usage.
- QLoRA: A memory-efficient fine-tuning method that combines quantization with LoRA to adapt large models on smaller hardware.
- Quantum Computing: Computing using quantum bits or qubits.
- Query: A request for data or information from a database.
R
- RAG (Retrieval-Augmented Generation): An AI framework that enhances the capabilities of Large Language Models (LLMs) by connecting them to external, up-to-date knowledge sources. When prompted, a RAG system first retrieves relevant information from a specified database or document collection and then provides this information as context to the LLM, which uses it to generate a more accurate, detailed, and factually grounded response.
- Random Forest: Ensemble method combining predictions from many decision trees.
- Reasoning Models: AI models designed to spend more computation on multi-step problem solving, math, coding, planning, or analysis before giving a final answer.
- Reasoning Trace: An explicit or implicit record of intermediate steps used by a model to reach a conclusion.
- Recall: Fraction of total relevant results correctly classified by algorithm.
- Red Teaming: Deliberately testing an AI system with challenging, adversarial, or risky cases to find failures before deployment.
- Recommender Systems: Predicting user preferences for products or content.
- Recurrent Neural Network (RNN): Neural networks with loops, allowing information to persist.
- Reflection: A technique where an AI system reviews and critiques its own output to improve future responses.
- Regression: Statistical models estimating relationships between variables.
- Reinforcement Learning from Human Feedback (RLHF): A training method that uses human preferences to fine-tune AI models, helping align their outputs with intended behavior.
- RLAIF (Reinforcement Learning from AI Feedback): An alignment method that uses AI-generated feedback or critiques to help train another model.
- Robotics: The field of designing, building, and controlling robots, often using AI for perception, planning, and autonomy.
- Rule-Based System: A computer system that uses human-written rules to make decisions.
S
- Self-attention: A mechanism within neural networks that allows them to weigh the importance of different inputs independently, useful particularly in transformer models for tasks like language understanding and translation.
- Self-Supervised Learning: Using unlabeled data to pretrain models.
- Semantic Segmentation: A process in computer vision that involves dividing an image into parts and classifying each part at the pixel level, helping the model understand and label whole scenes in detail.
- Semi-supervised Learning: Using both labeled and unlabeled data for training.
- Sentiment Analysis: Determining emotional tone behind text data.
- Sequence Model: Algorithms like RNNs and LSTMs for ordered data like text or time series.
- Siamese Networks: Neural nets that compare two inputs.
- Singular Value Decomposition (SVD): Matrix factorization method for reducing dimensionality.
- SLM (Small Language Model): A compact language model designed to run with lower cost, lower latency, or less memory than larger frontier models.
- Sovereign AI: The strategic initiative by nations to build and own their own AI infrastructure, data, and models to ensure digital independence and national security, rather than relying on foreign tech giants.
- Sora: OpenAI’s video generation model family for creating or editing video from prompts, images, or other visual inputs.
- Spatial Transformer Networks: A neural network module that explicitly allows the spatial manipulation of data within the network, enabling it to actively spatially transform feature maps according to the learned task.
- Speculative Decoding: An inference optimization method where smaller models predict tokens ahead to accelerate generation.
- Spike Neural Networks: Networks that incorporate the timing of neuron spike events, making them efficient for processing temporal data.
- Supervised Learning: Creating models from labeled training data.
- Structured Outputs: Model responses constrained to a specific schema, such as valid JSON, so software can parse them reliably.
- Support Vector Machine (SVM): A machine learning model used for classification and regression by finding decision boundaries between classes.
- Swarm Intelligence (AI Agents): Multiple agents operating collectively with decentralized decision-making.
- Synthetic Data: Artificially generated training data.
- System Prompt: Instructions given to AI models that define their role, behavior, and constraints, serving as persistent context that guides how they respond to user queries.
T
- Tensor: A mathematical object analogous to but more general than a vector.
- TensorFlow: End-to-end open source platform for machine learning.
- Text-to-Video Model: A generative model that creates video clips from written prompts, sometimes with image, audio, or reference inputs.
- Test-Time Compute: Additional computation allocated during inference to improve reasoning accuracy.
- Token: A chunk of text, code, image data, audio, or other input representation that a model processes as a basic unit.
- Tokenization: The process of breaking input into tokens that a model can process.
- Tool Calling: The ability of a model or agent to request external actions, such as searching a database, running code, opening a file, or calling an API.
- Tool-Augmented LLM: A language model that can use external tools, APIs, databases, files, or code execution to complete tasks.
- Transfer Learning: Applying knowledge gained in one domain to a related domain.
- Transformer: Attention-based neural network architecture.
- Tree-Based Models: Algorithms like random forests and gradient boosting using decision trees.
- Triplet Loss: A loss function used in machine learning to learn embeddings or transformations by comparing a base input to a positive input (similar) and a negative input (differing) to ensure that similar items are closer in the embedding space than differing items.
U
- Unsupervised Learning: Finding patterns in unlabeled, unclassified data.
- Underfitting: When a machine learning model is too simple and doesn’t capture the underlying trend of the data.
- Utility Theory: A decision-making approach based on the assumption that decisions are made to maximize pleasure and minimize pain.
V
- Validation Set: Data used to tune hyperparameters and evaluate models while training.
- Variable Selection: The process of choosing the most useful features from a larger set of possible inputs.
- Vector: An ordered list of numbers used to represent data such as words, images, users, or documents in a form a model can compare.
- Vector Database: A database designed to store embeddings and retrieve similar items quickly, often used in RAG systems.
- Vibe Coding: A coding trend in 2025 where developers focus on describing the high-level “vibe” or intent of an application to an AI, letting the AI handle the implementation details.
- Video Understanding Model: A model designed to interpret actions, events, and temporal relationships in video data.
- Vision-Language Models (VLMs): AI systems that can understand and generate content involving both visual and textual information, enabling tasks like image captioning, visual question answering, and multimodal reasoning.
W
- Weight Initialization: Strategies for initializing weights in neural networks prior to training.
- Weights: Values in a neural network that are adjusted during training.
- Word Embedding: The representation of words in dense vectors of real numbers.
- World Model: A model that learns representations of how an environment works, helping an AI system predict outcomes, plan actions, or simulate future states.
X
- XAI (Explainable AI): Making AI decisions understandable to humans.
- XGBoost: Scalable, optimized implementation of gradient boosting algorithm.
Y
- YOLO (You Only Look Once): A fast object detection algorithm family that identifies objects in images in a single pass.
Z
- Zero-Shot Learning: A model’s ability to handle a task, class, or instruction it was not explicitly trained on, often by using general knowledge learned during pretraining.
2025-2026 Update
Artificial intelligence has changed quickly since the first wave of consumer chatbots. Large language models are no longer used only as text generators. They now sit inside larger systems that involve agents, tools, memory, retrieval, structured outputs, reasoning, video generation, and multimodal inputs.
Modern AI literacy now requires more than understanding models and algorithms. It also requires familiarity with inference workflows, agent coordination, context management, prompt injection, evaluation, governance, and efficiency constraints. This updated glossary reflects those shifts while preserving the foundational terms that still help beginners understand how AI works.
AI Glossary FAQ
What are AI terms?
AI terms are words and phrases used to describe artificial intelligence concepts, tools, methods, and systems. Common examples include machine learning, neural network, large language model, generative AI, prompt, token, embedding, RAG, fine-tuning, and AI agent.
What AI terms should beginners learn first?
Beginners should start with artificial intelligence, machine learning, deep learning, neural network, natural language processing, large language model, generative AI, prompt, token, context window, hallucination, and AI agent. These terms appear across most modern AI tools and tutorials.
What is the difference between AI, machine learning, and deep learning?
Artificial intelligence is the broad field of building systems that perform intelligent tasks. Machine learning is a branch of AI where systems learn patterns from data. Deep learning is a branch of machine learning that uses neural networks with many layers.
Why do AI terms change so quickly?
AI terms change quickly because the field is moving from standalone models to systems that combine models, tools, memory, retrieval, agents, multimodal inputs, and reasoning workflows. New terms appear as new capabilities become common in real products.
Final Thoughts
AI terminology will continue to expand as models become more capable and AI systems become more connected to real tools, files, apps, and workflows. This glossary is designed to give beginners a durable foundation, not only a snapshot of current AI trends.
Use it as a quick reference when you encounter unfamiliar AI terms in product announcements, tutorials, research summaries, or tool documentation.










