N NexChron

GPT

Definition Generative Pre-trained Transformer — a family of large language models developed by OpenAI that generate coherent text by predicting subsequent tokens. GPT models popularized the pre-train-then-fine-tune paradigm that now dominates NLP research.

In Depth

GPT-1 (2018) demonstrated that unsupervised pre-training followed by task-specific fine-tuning could outperform task-specific training from scratch. GPT-3 (2020) showed that scaling alone unlocked few-shot capabilities without fine-tuning. GPT-4 added multimodal input and further improved reasoning and instruction-following.

Browse more terms

AI Agent AI Alignment Agentic AI Artificial General Intelligence Artificial Superintelligence Attention Mechanism AutoML Benchmark Bias (AI) Chain-of-Thought Computer Vision Deepfake Diffusion Model Edge AI Embedding Federated Learning Few-Shot Learning Fine-Tuning Function Calling GPT