Regularization is an important and effective technique for reducing generalization errors in traditional machine learning. The following techniques are regular.