Glossary of AI Terms

the new AI language

A

• AGI (Artificial general intelligence)

• AI Accelerator

• AI Agent

• AI Alignment

• AI Auditing (AI Forensic)

• AI Benchmarks

• AI Constitutions

• AI Control Problem

• AI Copilot

• AI Ethics

• AI Fluency

• AI Governance

• AI Guardrails

• AI Model Zoo

• AI Poisoning (black-hat SEO)

• AI Psychosis

• AI Safety

• AI Sovereignty

• AI Toxicity

• AI Workflow

• AI safety

• ANI (Artificial narrow intelligence)

• API Rate Limits

• API endpoints

• ASI (Artificial superintelligence)

• AVX-512

• AVX2

• Ablation

• Abliteration

• Activation Function

• Adam Optimizer

• Affirmative AI

• Agent Skill Malware

• Agent-to-Agent (A2A)

• Agentic AI

• AlexNet

• Algorithm

• Alignment Tax

• AlphaGo

• Anthropomorphism

• Apple Silicon

• Artificial Intelligence

• Attention Heads

• Attention Mechanism

• Automation

• Autonomous Agent

B

• BF16

• BLEU

• BM25

• BPE (Byte Pair Encoding)

• Backpropagation

• Batch

• Bayesian Networks

• Bias (in AI)

• Big Data

• Bitter Lesson

• Browser Agent

C

• CPU

• CUDA

• CUDA Cores

• Catastrophic Forgetting

• Chain of thought

• Chain-of-thought Prompting

• Chat template

• Chatbot

• Checkpoint

• Chinese Room

• Chunk Overlap

• Chunk Size

• Chunking

• Claw

• Closed Source

• Cloud AI

• Computer Use

• Computer Vision

• Constitutional AI

• Content Moderation

• Context Window

• Continued Pretraining (or Domain-adaptive Pretraining)

• Contrastive Learning

• Cross Encoder

• Curriculum Learning

D

• Dartmouth Workshop

• Data Augmentation

• Data Mining

• Decision Tree

• Decoder

• Decoder-only Models

• Deep Blue

• Deep Learning

• Diffusion Models

• Dimensionality Reduction

• Distillation

• Distributed Representation

E

• E2E (end-to-end learning)

• ELIZA

• ELO Benchmarks

• Edge AI

• Embedding Model

• Embeddings

• Emergent Behavior

• Encoder

• Encoder-only Models

• Encoder–Decoder Model

• Ensemble Methods

• Epoch

• Ethical AI

• Evaluation

• Expert Systems

F

• FP16

• FP8

• Federated Learning

• Feed-Forward Network (FFN)

• Few-Shot Learning

• Fine-Tuning

• Fine-Tuning vs Continued Pretraining

• Flash Attention

• Foundation Models

• Frontier AI model

• Function Calling (alongside Tool Calling)

G

• GANs (Generative Adversarial Networks)

• GEO (Generative Engine Optimization)

• GGUF (GPT-Generated Unified Format)

• GPT (Generative Pre-Trained Transformer)

• GPU (Graphics Processing Unit)

• GenAI (Generative AI)

• Goal Misgeneralization

• Goodhart’s Law (AI)

• Gradient

• Gradient Descent

• GQA (Grouped Query Attention)

• Guardrails

H

• HAI (Human-Centered Artificial Intelligence)

• HCI (Human-Computer Interaction)

• Hallucinations (in AI)

• Hugging Face

• Human Evaluation

• Human-in-the-Loop

• Hybrid Search

• Hyperparameter

I

• INT4

• INT8

• ImageNet

• Inference

• Inference Server

• Inference vs Training

• Instruction Tuning

• Instrumental Convergence

• Interpretability

• IoT (Internet of Things)

J

• JAX

• JSON Mode

• Jailbreak

• Joint Embedding

• Judge Model

K

• KV Cache

• KV Quantization

• Knowledge Graph

• k-NN (k-Nearest Neighbors)

L

• llama.cpp

• LLM (Large Language Model)

• LLMOps (Large Language Model Operations)

• Language reasoning

• Latency

• Latent Space

• Learning Rate

• LoRA (Low-Rank Adaptations)

• Local AI

• Local AI hardware

• Local LLM

• Loss Function

M

• MCP (Model Context Protocol)

• ML (Machine Learning)

• MLOps (Machine Learning Operations)

• MMLU

• Markov Chain

• Matrix Multiplication

• Memorization (rather than the intended generalization during training)

• Memory vs Context Window

• Metal

• Mini-batch

• Mmap (memory mapping)

• MoE (Mixture of Experts)

• Model

• Model Drift

• Model Hub

• Model types

• Model vs Architecture

• Modern AI

• Moravec’s Paradox

• Multi-Agent System

• Multi-Head Attention

• Multimodal AI

• Multimodal Foundation Models

N

• NLP (Natural Language Processing)

• NPU (Neural Processing Unit)

• Neural Network

• Neural Reasoning

O

• Ollama

• Open Source

• Open Source vs Open Weight

• Open-Weight Model

• Optimization Algorithm

• Optimizer

• Orthogonality Thesis

• Overfitting

P

• Paperclips (The Paperclip Maximiser theory)

• Parameter

• Parameters vs Weights

• Perceptron

• Perplexity

• Persona Prompting

• Pipeline Parallelism

• Positional Embeddings

• Positional Encoding

• Practical AI

• Predictive Analytics

• Private reasoning

• Prompt

• Prompt Caching

• Prompt Chaining

• Prompt Compression

• Prompt Engineering

• Prompt Injection

• Prompting

Q

• Quantization

• Quantization Levels

R

• RAG (Retrieval-Augmented Generation)

• RAG ecosystem

• RAM

• RLHF (Reinforcement Learning from Human Feedback)

• ROCm

• ROUGE

• Re-ranking

• Reasoning Models

• Residual Stream

• Responsible AI

• Retriever

• Reward Hacking

• RoPE (Rotary Positional Embeddings)

• Robotics

• Role Prompting

S

• SGD (Stochastic Gradient Descent)

• Scaling Hypothesis

• Scaling Laws

• Self-Attention

• Self-Supervised Learning

• Semantic Analysis

• Semantic Search

• Serving

• Simulators Theory

• Single Direction

• Sliding Window Attention

• Slop

• Small Language Models (SLM)

• Sparse Attention

• Spatial Intelligence

• Speculative Decoding

• Stochastic Parrot

• Structured Outputs

• Style transfer

• Supervised Learning

• Sycophantic chatbots (sycophancy)

• Synthetic Data

• System Prompt

T

• Temperature (AI Temperature)

• Temperature vs Randomness

• Tensor

• Tensor Cores

• Tensor Parallelism

• Throughput

• Token

• Token Unmaxxing

• Tokenization

• Tokenizer

• Tokens per second (TPS)

• Tokens vs Words

• Tool Calling

• Traditional AI

• Training

• Training Data

• Transfer Learning

• Transformer

• Transformer Layer

• Turing Test

U

• Uncensored (AI Model)

• Unified Memory

• Unsupervised Learning

V

• vLLM

• VRAM

• Vector Database

• Vector Search

• ViT (Vision Transformer)

• Vibe Coding

• Vision-Language Models (VLM)

• Vulkan

W

• Weak AI (narrow AI)

• Weight Orthogonalization

• Weights (Model Weights)

• Wireheading

• World Models

X

• XAI (Explainable AI)

• XML Prompting

Y

• YAML

• YOLO (You Only Look Once)

• Yield

Z

• Zero-Shot Learning