The different optimization algorithms implemented in the crate are described in this section. The optimizer updates the parameters of the model once the backprop algorithm has completed.
Adaptive moments
RMSProp
Stochastic Gradient Descent