Docs Reference People Papers

Docs Reference People Papers

FAQ Introduction A-Z Index

Expert System Perceptron word2vec

AI (Artificial Intelligence)Machine Learning (ML)Deep Learning Neural Network Activation Function Gradient Descent Backpropagation Vanishing/Exploding Gradients Weight Initialization Batch/Layer Normalization Residual Connection Universal Approximation Theorem Loss Function Overfitting Regularization Bias-Variance Tradeoff Train/Validation/Test Split

Probability Distribution Bayes' Theorem MLE (Maximum Likelihood Estimation)MAP (Maximum a Posteriori Estimation)

CNN (Convolutional Neural Network)OpenCV AlexNet ResNet ViT (Vision Transformer)CLIP (Contrastive Language-Image Pretraining)Data Augmentation

GAN (Generative Adversarial Network)VAE (Variational Autoencoder)Diffusion Model

Transformer Attention (Self-Attention)Positional Encoding RoPE (Rotary Positional Embedding)Causal Masking Encoder-Decoder Architecture RNN (Recurrent Neural Network)LLM (Large Language Model)Tokenization Embedding Pretraining Fine-tuning LoRA (Low-Rank Adaptation)RLHF (Reinforcement Learning from Human Feedback)DPO (Direct Preference Optimization)Scaling Laws Mixture of Experts Decoding Strategies (Temperature, Top-k, Top-p)Hallucination

MDP (Markov Decision Process)Reward Policy Q-Learning PPO (Proximal Policy Optimization)

Inference Quantization Knowledge Distillation KV Cache Speculative Decoding Tensor Parallelism Batching (Continuous Batching)RAG (Retrieval-Augmented Generation)Vector Database Prompt Engineering Agent MCP (Model Context Protocol)

Benchmark LLM-as-Judge

AI Safety Alignment Interpretability Sparse Autoencoder (SAE)Prompt Injection Jailbreak Adversarial Example Red Teaming

PyTorch TensorFlow JAX Hugging Face Distributed Training (FSDP, DeepSpeed, Megatron-LM)CUDA GPU (Graphics Processing Unit)

A-Z Index

Every term in the glossary, alphabetically, on one page — for browsing or jumping straight to a specific one.

Every reference entry, alphabetically. Browsing by topic instead? The sidebar groups these same terms by subject.

A B C D E F G H I J K L M N O P Q R S T U V W

A

Activation Function
Adversarial Example
Agent
AI (Artificial Intelligence)
AI Safety
AlexNet
Alignment
Attention (Self-Attention)

B

Backpropagation
Batch/Layer Normalization
Batching (Continuous Batching)
Bayes' Theorem
Benchmark
Bias-Variance Tradeoff

C

Causal Masking
CLIP (Contrastive Language-Image Pretraining)
CNN (Convolutional Neural Network)
CUDA

D

Data Augmentation
Decoding Strategies (Temperature, Top-k, Top-p)
Deep Learning
Diffusion Model
Distributed Training (FSDP, DeepSpeed, Megatron-LM)
DPO (Direct Preference Optimization)

E

Embedding
Encoder-Decoder Architecture
Expert System

F

Fine-tuning

G

GAN (Generative Adversarial Network)
GPU (Graphics Processing Unit)
Gradient Descent

H

Hallucination
Hugging Face

I

Inference
Interpretability

J

Jailbreak
JAX

K

Knowledge Distillation
KV Cache

L

LLM (Large Language Model)
LLM-as-Judge
LoRA (Low-Rank Adaptation)
Loss Function

M

Machine Learning (ML)
MAP (Maximum a Posteriori Estimation)
MCP (Model Context Protocol)
MDP (Markov Decision Process)
Mixture of Experts
MLE (Maximum Likelihood Estimation)

N

Neural Network

O

OpenCV
Overfitting

P

Perceptron
Policy
Positional Encoding
PPO (Proximal Policy Optimization)
Pretraining
Probability Distribution
Prompt Engineering
Prompt Injection
PyTorch

Q

Q-Learning
Quantization

R

RAG (Retrieval-Augmented Generation)
Red Teaming
Regularization
Residual Connection
ResNet
Reward
RLHF (Reinforcement Learning from Human Feedback)
RNN (Recurrent Neural Network)
RoPE (Rotary Positional Embedding)

S

Scaling Laws
Sparse Autoencoder (SAE)
Speculative Decoding

T

Tensor Parallelism
TensorFlow
Tokenization
Train/Validation/Test Split
Transformer

U

Universal Approximation Theorem

V

VAE (Variational Autoencoder)
Vanishing/Exploding Gradients
Vector Database
ViT (Vision Transformer)

W

Weight Initialization
word2vec

Introduction

A glossary of AI, machine learning, and LLM terms — short definitions with links to the full lessons and external sources.

Expert System

An expert system encodes a human expert's domain knowledge as hand-written if-then rules plus an inference engine, the dominant AI approach of the 1970s-80s.