Generalizing the Training

It is important to note that Machine Learning techniques encompass much more than mere optimization. One of the objectives set during training is to ensure that the system is capable of classifying new samples that it has not yet encountered. One approach to combat overfitting is "regularization." There are various techniques in the literature for regularization: the main ones are L1/L2 regularization and early stopping (early-stopping).