gradient descent noun1 •A first-order iterative optimization algorithm for finding a local minimum of a differentiable function.Thus, in gradient descent, on each epoch, we perform the parameter update. — 2019