Regularization rate

A number that specifies the relative importance of regularization during training. Raising the regularization rate reduces overfitting but may reduce the model’s predictive power. Conversely, reducing or omitting the regularization rate increases overfitting.¹

The regularization rate is usually represented as $\lambda$. The following simplified loss equation shows lambda’s influence:¹

$$minimize(loss function + \lambda(regularization))$$

where regularization is any regularization mechanism, including:

• L1 regularization
• L2 regularization

Footnotes

1. developers.google.com/machine-learning/glossary#regularization_rate ↩ ↩²