Parameter Norm Penalties

$L^2$ Regularization

$L^1$ Regularization

Norm Penalties as Constrained Optimization

Regularization and Under-Constrained Problems