What is Autoregressive Model?

Autoregressive Model

Definition An AI model that generates output one token at a time, with each new token conditioned on all previous tokens.

In Depth

GPT, Claude, and Llama are all autoregressive models. They predict the next most likely token given everything that came before. This is why they generate text sequentially rather than all at once. The autoregressive approach is simple but effective and dominates current language AI.

Browse more terms

AI Agent AI Alignment Agentic AI Artificial General Intelligence Artificial Superintelligence Attention Mechanism AutoML Autoregressive Model Benchmark Bias (AI) CLIP Chain-of-Thought Computer Vision Constitutional AI Context Window DPO (Direct Preference Optimization) Deepfake Diffusion Model Document AI Edge AI