Early Stopping

Early stopping directly combats overfitting by monitoring the model's performance on an additional set of examples called the validation set (validation set). When the objective function on the validation set stops decreasing for a certain number of iterations and instead begins to worsen, training is stopped because the model is suspected of beginning to overfit the problem.