Gradient Descent

An optimization algorithm that iteratively adjusts model parameters to minimize the loss function. Foundation of neural network training.