-
The Gradient Descent Algorithm
The gradient descent algorithm turns up nearly everywhere in machine learning. This algorithm is intensely popular because it is excellent at solving certain types of optimization problems. It must be used thoughtfully, however, since it is not guaranteed to converge to global extrema. It's absolutely essential for machine learning engineers to understand the mathematics of this ubiquitous algorithm.