Stochastic gradient descent

1 photo

t(SGD) is a simple optimization algorithm, widely used in ML, often combined with backpropagation. SGD iteratively makes small adjustments to a ML network to decrease the error of the network