Gradient descent Machine Learning
noun phrase
Definition: An iterative optimization algorithm that updates model parameters in the direction opposite to the gradient to minimize a differentiable objective function [Keras / TensorFlow optimizer docs].
Example in context: “In this process, we adopt gradient descent to obtain the optimal solution.” [Liu et al. 2024]
Related terms: stochastic gradient descent (SGD); batch gradient descent; learning rate