N NexChron

Parameter

Definition A learnable numerical value inside a neural network — typically a weight or bias — that is adjusted during training to minimize the model's prediction error. The count of parameters is the most common shorthand for model size.

In Depth

GPT-3 has 175 billion parameters; the largest frontier models today exceed one trillion. Parameters store the compressed knowledge acquired during training, but raw parameter count is an imperfect proxy for capability — data quality, architecture, and training procedure matter equally. Researchers also study how parameter count scales with capability in power-law "scaling laws."

Browse more terms

AI Agent AI Alignment Agentic AI Artificial General Intelligence Artificial Superintelligence Attention Mechanism AutoML Benchmark Bias (AI) Chain-of-Thought Computer Vision Deepfake Diffusion Model Edge AI Embedding Federated Learning Few-Shot Learning Fine-Tuning Function Calling GPT