The table below shows all optimizers that are available in
mlr3torch:
| Key | Label |
|---|---|
| adagrad | Adaptive Gradient algorithm |
| adam | Adaptive Moment Estimation |
| adamw | Decoupled Weight Decay Regularization |
| rmsprop | Root Mean Square Propagation |
| sgd | Stochastic Gradient Descent |