{"id":25548341,"date":"2022-11-27T12:53:27","date_gmt":"2022-11-27T07:23:27","guid":{"rendered":"https:\/\/entri.app\/blog\/?p=25548341"},"modified":"2023-05-24T13:23:53","modified_gmt":"2023-05-24T07:53:53","slug":"what-is-regularization-in-machine-learning","status":"publish","type":"post","link":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/","title":{"rendered":"What is Regularization in Machine Learning?"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_79_2 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-69e16747017cf\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-69e16747017cf\"  aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><ul class='ez-toc-list-level-2' ><li class='ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#What_Are_Overfitting_and_Underfitting\" >What Are Overfitting and Underfitting?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#What_are_Bias_and_Variance\" >What are Bias and Variance?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#What_is_Regularization_in_Machine_Learning\" >What is Regularization in Machine Learning?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#Regularization_Techniques\" >Regularization Techniques\u00a0<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#Ridge_Regularization\" >Ridge Regularization :<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#Lasso_Regression\" >Lasso Regression\u00a0<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#Regularization_Using_Python_in_Machine_Learning\" >Regularization Using Python in Machine Learning<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#Conclusion\" >Conclusion<\/a><\/li><\/ul><\/nav><\/div>\n<p>A machine learning model can quickly become overfitted or under fitted during training. To prevent this, we properly fit a model onto our test set using regularisation in machine learning. Regularization methods aid in obtaining the best model by lowering the likelihood of overfitting.<\/p>\n<h2><a href=\"https:\/\/entri.app\/course\/data-science-and-machine-learning-course\/\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-25531373 size-full\" src=\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/07\/Python-and-Machine-Learning-Rectangle-1.png\" alt=\"\" width=\"970\" height=\"250\" srcset=\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/07\/Python-and-Machine-Learning-Rectangle-1.png 970w, https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/07\/Python-and-Machine-Learning-Rectangle-1-300x77.png 300w, https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/07\/Python-and-Machine-Learning-Rectangle-1-768x198.png 768w, https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/07\/Python-and-Machine-Learning-Rectangle-1-750x193.png 750w\" sizes=\"auto, (max-width: 970px) 100vw, 970px\" \/><\/a><\/h2>\n<p><strong><div class=\"lead-gen-block\"><a href=\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2023\/05\/1_merged-3_compressed.pdf\" data-url=\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2023\/05\/1_merged-3_compressed.pdf\" class=\"lead-pdf-download\" data-id=\"25556853\"><\/strong><\/p>\n<p style=\"text-align: center;\"><button class=\"btn btn-default\">Free SQL Tutorial for Beginners &#8211; Download PDF<\/button><\/p>\n<p><strong><\/a><\/div><\/strong><\/p>\n<h2 id=\"what_are_overfitting_and_underfitting\"><span class=\"ez-toc-section\" id=\"What_Are_Overfitting_and_Underfitting\"><\/span><strong>What Are Overfitting and Underfitting?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>We provide some data for our machine learning model to learn from. Data fitting is the act of plotting a set of data points and constructing the best fit line to reveal the relationship between the variables. The best fit for our model is when it can identify all relevant patterns in our data while avoiding noise, random data points, and pointless patterns. If we give our machine learning model too much time to examine the data, it will discover numerous patterns in it, including ones that are superfluous. On the test dataset, it will learn extremely quickly and adapt very effectively. It will pick up on significant patterns and noise in our data, but it won&#8217;t be able to predict other datasets because of this.<\/p>\n<p style=\"text-align: center;\"><a href=\"https:\/\/entri.app\/course\/data-science-and-machine-learning-course\/\">Click here to join machine learning course in Entri app<\/a><\/p>\n<p>Overfitting is a situation where the machine learning model attempts to learn from the specifics as well as the noise in the data and tries to fit each data point on the curve. The model is fit for every point in our data. If given new data, the model curves may not correspond to the patterns in the new data, and the model cannot predict it very well in it.\u00a0 On the other hand, the model won&#8217;t be able to recognize patterns in our test dataset if it hasn&#8217;t had enough opportunities to examine our data. It won&#8217;t perform well on new data and won&#8217;t fit our test dataset correctly. Underfitting describes a situation in which a machine learning model is unable to predict or categorize a new data point, nor can it understand the link between variables in the testing data. A poorly fitting model can be seen in the diagram below. We can see that it has not properly matched the provided data. It has ignored a sizable portion of the dataset and failed to identify any patterns in the data. It can&#8217;t operate on both known and unknown<\/p>\n<h2 id=\"what_are_bias_and_variance\"><span class=\"ez-toc-section\" id=\"What_are_Bias_and_Variance\"><\/span><strong>What are Bias and Variance?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>A bias develops when an algorithm&#8217;s capacity to learn from data is constrained. Such models oversimplify the model and pay very little attention to the training data; as a result, the patterns in the validation error, prediction error, and training error are identical. These models invariably produce large errors on training and test data. In our model, high bias results in underfitting. The algorithm&#8217;s sensitivity to particular kinds of data is determined by variation. The validation error and prediction error are far apart in a model with a high variance because it concentrates on training data and does not generalize. On training data, these models typically exhibit excellent performance, but on test data, they exhibit high error rates. In our model, high variance leads to overfitting.<\/p>\n<p>An ideal model is one that can generalize to new data while still being sensitive to the pattern in our model. When both Bias and Variance are at their best, this occurs. By using regression, we can achieve this bias-variance tradeoff in overfitted or underfitted models. As we can see, when bias is large, both the testing set&#8217;s and the training set&#8217;s error are also high. The model performs well on our training set and yields a low error when Variance is high, but the error on our testing set is rather high. There is a region in the middle of this where the bias and variance are perfectly balanced to one another, but training and testing errors are minimal.<\/p>\n<p><a href=\"https:\/\/entri.app\/course\/data-science-and-machine-learning-course\/\">\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Click here to join machine learning course in Entri app<\/a><\/p>\n<h2 id=\"what_is_regularization_in_machine_learning\"><span class=\"ez-toc-section\" id=\"What_is_Regularization_in_Machine_Learning\"><\/span><strong>What is Regularization in Machine Learning?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Regularization refers to techniques that are used to calibrate machine learning models in order to minimize the adjusted loss function and prevent overfitting or underfitting. Using Regularization, we can fit our machine learning model appropriately on a given test set and hence reduce the errors in it.<\/p>\n<h2 id=\"regularization_techniques\"><span class=\"ez-toc-section\" id=\"Regularization_Techniques\"><\/span><strong>Regularization Techniques\u00a0<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>There are two main types of regularization techniques: Ridge Regularization and Lasso Regularization.<\/p>\n<h2 id=\"ridge_regularization_\"><span class=\"ez-toc-section\" id=\"Ridge_Regularization\"><\/span><strong>Ridge Regularization<\/strong> :<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>It is also referred to as Ridge Regression and modifies over or under-fitted models by applying a penalty equal to the sum of the squares of the coefficient magnitude. As a result, coefficients are produced and the mathematical function that represents our machine learning model is minimised. The coefficients&#8217; magnitudes are squared and summed. Ridge Regression applies regularisation by reducing the number of coefficients. The cost function of ridge regression is shown in the function below: The penalty term is represented by Lambda in the cost function. We can control the punishment term by varying the values of the penalty function. The magnitude of the coefficients decreases as the penalty increases. The settings are trimmed. As a result, it serves to prevent multicollinearity and, through coefficient shrinkage, lower the model&#8217;s complexity.<\/p>\n<p><a href=\"https:\/\/entri.app\/course\/data-science-and-machine-learning-course\/\">\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Click here to join machine learning course in Entri app<\/a><\/p>\n<p>Take a look at the graph below, which shows linear regression:<\/p>\n<p>Cost function = Loss + \u03bb x\u2211\u2016w\u2016^2<\/p>\n<p>For Linear Regression line, let\u2019s consider two points that are on the line,<\/p>\n<p>Loss = 0 (considering the two points on the line)<\/p>\n<p>\u03bb= 1<\/p>\n<p>w = 1.4<\/p>\n<p>Then, Cost function = 0 + 1 x 1.42<\/p>\n<p>= 1.96<\/p>\n<p>For Ridge Regression, let\u2019s assume,<\/p>\n<p>Loss = 0.32 + 0.22 = 0.13<\/p>\n<p>\u03bb = 1<\/p>\n<p>w = 0.7<\/p>\n<p>Then, Cost function = 0.13 + 1 x 0.72<\/p>\n<p>= 0.62<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/ridge.JPG\" alt=\"ridge.\" width=\"358\" height=\"246\" \/><\/p>\n<p>Figure 9: Ridge regression model<\/p>\n<p>Comparing the two models, with all data points, we can see that the Ridge regression line fits the model more accurately than the linear regression line.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/optimization.JPG\" alt=\"optimization\" width=\"335\" height=\"221\" \/><\/p>\n<p>Figure 10: Optimization of model fit using Ridge Regression<\/p>\n<p style=\"text-align: center;\"><a href=\"https:\/\/entri.app\/course\/data-science-and-machine-learning-course\/\">Click here to join machine learning course in Entri app<\/a><\/p>\n<h2 id=\"lasso_regression\"><span class=\"ez-toc-section\" id=\"Lasso_Regression\"><\/span><strong>Lasso Regression\u00a0<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>By imposing a penalty equal to the total of the absolute values of the coefficients, it alters the models that are either overfitted or underfitted. Lasso regression likewise attempts coefficient minimization, but it uses the actual coefficient values rather than squaring the magnitudes of the coefficients. As a result of the presence of negative coefficients, the coefficient sum can also be 0. Think about the Lasso regression cost function: We can control the coefficient values by controlling the penalty terms, just like we did in Ridge Regression. Again consider a Linear Regression model :<\/p>\n<p>Cost function = Loss + \u03bb x \u2211\u2016w\u2016<\/p>\n<p>For the Linear Regression line, let\u2019s assume,<\/p>\n<p>Loss = 0 (considering the two points on the line)<\/p>\n<p>\u03bb = 1<\/p>\n<p>w = 1.4<\/p>\n<p>Then, Cost function = 0 + 1 x 1.4<\/p>\n<p>= 1.4<\/p>\n<p>For Ridge Regression, let\u2019s assume,<\/p>\n<p>Loss = 0.32 + 0.12 = 0.1<\/p>\n<p>\u03bb = 1<\/p>\n<p>w = 0.7<\/p>\n<p>Then, Cost function = 0.1 + 1 x 0.7<\/p>\n<p>= 0.8<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/s3.amazonaws.com\/static2.simplilearn.com\/ice9\/free_resources_article_thumb\/lasso-reg.JPG\" alt=\"lasso-reg\" width=\"358\" height=\"258\" \/><\/p>\n<p>Comparing the two models, with all data points, we can see that the Lasso regression line fits the model more accurately than the linear regression line.<\/p>\n<h2 id=\"regularization_using_python_in_machine_learning\"><span class=\"ez-toc-section\" id=\"Regularization_Using_Python_in_Machine_Learning\"><\/span><strong>Regularization Using Python in Machine Learning<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Let&#8217;s look at how regularization can be implemented in\u00a0Python.\u00a0We have taken the Boston Housing Dataset on which we will be using\u00a0Linear Regression to predict housing prices in Boston.\u00a0 We start by importing all the necessary modules.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/importing-modules.JPG\" alt=\"importing-modules\" width=\"399\" height=\"108\" \/><\/p>\n<p>Figure 11: Importing modules in python<\/p>\n<p>We then load the Boston Housing Dataset from sklearn\u2019s datasets.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/boston.JPG\" alt=\"boston\" width=\"304\" height=\"51\" \/><\/p>\n<p>Figure 12: Loading Boston Housing Dataset<\/p>\n<p>We then convert the dataset into a DataFrame and set the columns and the target variable.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/converting-dataset.JPG\" alt=\"converting-dataset\" width=\"515\" height=\"230\" \/><\/p>\n<p>Figure 13: Converting dataset into DataFrame<\/p>\n<p>The below figure shows us the Boston housing dataset.<\/p>\n<p><img decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/s3.amazonaws.com\/static2.simplilearn.com\/ice9\/free_resources_article_thumb\/boston-housing.JPG\" alt=\"boston-housing\" \/><\/p>\n<p>Figure 14: Boston Housing Dataset<\/p>\n<p>We then split our data into training and testing sets.<\/p>\n<p><img decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/s3.amazonaws.com\/static2.simplilearn.com\/ice9\/free_resources_article_thumb\/splitting-training.JPG\" alt=\"splitting-training\" \/><\/p>\n<p>Figure 15: Splitting into training and testing sets<\/p>\n<p>We can now use these to train our Linear Regression model. We start by creating our model and fitting the data to it. We then predict on the test set and find the error in our prediction using mean_squared_error. Finally, we print the coefficients of our Linear Regression model.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/s3.amazonaws.com\/static2.simplilearn.com\/ice9\/free_resources_article_thumb\/linear-regression.JPG\" alt=\"linear-regression\" width=\"403\" height=\"251\" \/><\/p>\n<p>Figure 16: Linear Regression<\/p>\n<p>The coefficients of our Linear Regression model are given below.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/coefficients.JPG\" alt=\"\/coefficients\" width=\"403\" height=\"251\" \/><\/p>\n<p>Figure 17: Coefficients of Linear Regression<\/p>\n<p>Now, let\u2019s plot the coefficient score.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/plotting.JPG\" alt=\"plotting\" width=\"529\" height=\"279\" \/><\/p>\n<p>Figure 17: Plotting coefficient score of Linear Regression model<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/score.JPG\" alt=\"score.\" width=\"634\" height=\"316\" \/><\/p>\n<p>Figure 18: Coefficient score of Linear Regression model<\/p>\n<p>Now, let us perform Ridge regression and plot the new coefficients that we get from it.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/ridge-regression.JPG\" alt=\"ridge-regression\" width=\"516\" height=\"254\" \/><\/p>\n<p>Figure 19: Ridge Regression and plotting coefficients<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/coefficients-n.JPG\" alt=\"coefficients-n\" width=\"355\" height=\"235\" \/><\/p>\n<p>Figure 20: Coefficients of Ridge Regression model<\/p>\n<p>Now let\u2019s plot the coefficient score of the Ridge Regression model<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/regression-moedel.JPG\" alt=\"regression-moede\" width=\"381\" height=\"237\" \/><\/p>\n<p>Figure 21: Plotting coefficient score of Ridge Regression model<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/figure22.JPG\" alt=\"fig 22\" width=\"528\" height=\"270\" \/><\/p>\n<p>Figure 22: Coefficient score of Ridge Regression model<\/p>\n<p>Let\u2019s perform Lasso Regression and find the coefficients for it.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/figure23.JPG\" alt=\"figure23\" width=\"453\" height=\"258\" \/><\/p>\n<p>Figure 23: Lasso Regression and plotting coefficients<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"blend-mode\" src=\"https:\/\/www.simplilearn.com\/ice9\/free_resources_article_thumb\/last-fig.JPG\" alt=\"ast-fig\" width=\"380\" height=\"250\" \/><\/p>\n<p>Figure 23: Coefficients of the Lasso Regression model<\/p>\n<h1><span class=\"ez-toc-section\" id=\"Conclusion\"><\/span><strong>Conclusion<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h1>\n<p>The different ways that models might become unstable by being under or over-fitted were introduced to us in this article, The Best Guide to Regularization in Machine Learning. Additionally, we observed how bias and variance function in model optimization. After that, we looked at several regularisation strategies to combat over and under-fitting. Finally, a demo showed us how to apply regularisation in Python. Was this regularisation article helpful to you? Do you have any lingering concerns or queries for us? If you leave them in the comments section of this post, we&#8217;ll immediately have our experts respond to them.<\/p>\n<h3>Free Tutorials To Learn<\/h3>\n<table dir=\"ltr\" border=\"1\" cellspacing=\"0\" cellpadding=\"0\">\n<colgroup>\n<col width=\"176\" \/>\n<col width=\"100\" \/><\/colgroup>\n<tbody>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;SQL Tutorial for Beginners PDF - Learn SQL Basics&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/sql-tutorial\/\">SQL Tutorial for Beginners PDF &#8211; Learn SQL Basics<\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Learn Now&quot;}\"><strong><div class=\"lead-gen-block\"><a href=\"https:\/\/entri.app\/blog\/sql-tutorial\/\" data-url=\"https:\/\/entri.app\/blog\/sql-tutorial\/\" class=\"lead-pdf-download\" data-id=\"25556853\"><\/strong><\/p>\n<p><button class=\"btn btn-default\">Learn Now<br \/>\n<\/button><\/p>\n<p><strong><\/a><\/div><\/strong><\/td>\n<\/tr>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;HTML Exercises to Practice | HTML Tutorial&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/html-exercises-to-practice-html-tutorial\/\">HTML Exercises to Practice | HTML Tutorial<\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Learn Now&quot;}\"><strong><div class=\"lead-gen-block\"><a href=\"https:\/\/entri.app\/blog\/html-exercises-to-practice-html-tutorial\/\" data-url=\"https:\/\/entri.app\/blog\/html-exercises-to-practice-html-tutorial\/\" class=\"lead-pdf-download\" data-id=\"25556853\"><\/strong><\/p>\n<p><button class=\"btn btn-default\">Learn Now<br \/>\n<\/button><\/p>\n<p><strong><\/a><\/div><\/strong><\/td>\n<\/tr>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;DSA Practice Series | DSA Tutorials&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/dsa-practice-series-dsa-tutorials\/\">DSA Practice Series | DSA Tutorials<\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Learn Now&quot;}\"><strong><div class=\"lead-gen-block\"><a href=\"https:\/\/entri.app\/blog\/dsa-practice-series-dsa-tutorials\/\" data-url=\"https:\/\/entri.app\/blog\/dsa-practice-series-dsa-tutorials\/\" class=\"lead-pdf-download\" data-id=\"25556853\"><\/strong><\/p>\n<p><button class=\"btn btn-default\">Learn Now<br \/>\n<\/button><\/p>\n<p><strong><\/a><\/div><\/strong><\/td>\n<\/tr>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Java Programming Notes PDF 2023&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/java-programming-notes-pdf\/\">Java Programming Notes PDF 2023<\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Learn Now&quot;}\"><strong><div class=\"lead-gen-block\"><a href=\"https:\/\/entri.app\/blog\/java-programming-notes-pdf\/\" data-url=\"https:\/\/entri.app\/blog\/java-programming-notes-pdf\/\" class=\"lead-pdf-download\" data-id=\"25556853\"><\/strong><\/p>\n<p><a href=\"https:\/\/entri.app\/blog\/java-programming-notes-pdf\/\"><button class=\"btn btn-default\">Learn Now<br \/>\n<\/button><\/a><\/p>\n<p><strong><\/a><\/div><\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h4><strong>Related Articles<\/strong><\/h4>\n<div class=\"table-responsive wprt_style_display\">\n<div class=\"table-responsive wprt_style_display\">\n<table class=\"table\" dir=\"ltr\" border=\"1\" cellspacing=\"0\" cellpadding=\"0\">\n<colgroup>\n<col width=\"329\" \/>\n<col width=\"309\" \/><\/colgroup>\n<tbody>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Syllabus&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/kerala-psc-village-field-assistant-vfa-syllabus-exam-pattern\/\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/data-science-jobs-in-kerala\/\" target=\"_blank\" rel=\"noopener\">Data Science Jobs in Kerala<\/a><\/strong><\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Mock Test&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/kerala-psc-vfa-free-mock-test\/\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/importance-of-data-preprocessing-in-machine-learning\/\" target=\"_blank\" rel=\"noopener\">Importance of Data Preprocessing in Machine Learning<\/a><\/strong><\/td>\n<\/tr>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Exam Date&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/kerala-psc-vfa-exam-date\/\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/understanding-machine-learning-basics-a-simple-guide\/\" target=\"_blank\" rel=\"noopener\">Understanding Machine Learning Basics<\/a><\/strong><\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Video Course&quot;}\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/data-science-interview-questions-answers\/\" target=\"_blank\" rel=\"noopener\">Top 100 Data Science Interview Questions and Answers 2023<\/a><\/strong><\/td>\n<\/tr>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Application Form&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/kerala-psc-vfa-apply-online\/\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/\" target=\"_blank\" rel=\"noopener\">What is Regularization in Machine Learning?<\/a><\/strong><\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Study Materials&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/kerala-psc-vfa-study-material\/\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/data-analysis-process-methods-types\/\" target=\"_blank\" rel=\"noopener\">Data Analysis \u2013 Process, Methods, Types<\/a><\/strong><\/td>\n<\/tr>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Vacancy&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/kerala-psc-vfa-vacancy\/\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/data-science-life-cycle\/\" target=\"_blank\" rel=\"noopener\">What is Data Science Life Cycle?<\/a><\/strong><\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Interview Questions&quot;}\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/top-10-applications-of-machine-learning-in-2022\/\" target=\"_blank\" rel=\"noopener\">Top 10 Applications of Machine Learning in 2023<\/a><\/strong><\/td>\n<\/tr>\n<tr>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Admit Card&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/kerala-psc-vfa-admit-card\/\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/top-50-data-analyst-interview-questions\/\" target=\"_blank\" rel=\"noopener\">Top 50 Data Analyst Interview Questions<\/a><\/strong><\/td>\n<td data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;Kerala PSC VFA Job Profile&quot;}\" data-sheets-hyperlink=\"https:\/\/entri.app\/blog\/kerala-psc-vfa-job-profile\/\"><strong><a class=\"in-cell-link\" href=\"https:\/\/entri.app\/blog\/exploratory-data-analysis-in-machine-learning\/\" target=\"_blank\" rel=\"noopener\">Exploratory Data Analysis in Machine Learning<\/a><\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n<p style=\"text-align: left;\"><div class=\"modal\" id=\"modal25556853\"><div class=\"modal-content\"><span class=\"close-button\">&times;<\/span>\n\n<div class=\"wpcf7 no-js\" id=\"wpcf7-f25556853-o1\" lang=\"en-US\" dir=\"ltr\" data-wpcf7-id=\"25556853\">\n<div class=\"screen-reader-response\"><p role=\"status\" aria-live=\"polite\" aria-atomic=\"true\"><\/p> <ul><\/ul><\/div>\n<form action=\"\/blog\/wp-json\/wp\/v2\/posts\/25548341#wpcf7-f25556853-o1\" method=\"post\" class=\"wpcf7-form init\" aria-label=\"Contact form\" novalidate=\"novalidate\" data-status=\"init\">\n<fieldset class=\"hidden-fields-container\"><input type=\"hidden\" name=\"_wpcf7\" value=\"25556853\" \/><input type=\"hidden\" name=\"_wpcf7_version\" value=\"6.1.4\" \/><input type=\"hidden\" name=\"_wpcf7_locale\" value=\"en_US\" \/><input type=\"hidden\" name=\"_wpcf7_unit_tag\" value=\"wpcf7-f25556853-o1\" \/><input type=\"hidden\" name=\"_wpcf7_container_post\" value=\"0\" \/><input type=\"hidden\" name=\"_wpcf7_posted_data_hash\" value=\"\" \/><input type=\"hidden\" name=\"_wpcf7cf_hidden_group_fields\" value=\"[]\" \/><input type=\"hidden\" name=\"_wpcf7cf_hidden_groups\" value=\"[]\" \/><input type=\"hidden\" name=\"_wpcf7cf_visible_groups\" value=\"[]\" \/><input type=\"hidden\" name=\"_wpcf7cf_repeaters\" value=\"[]\" \/><input type=\"hidden\" name=\"_wpcf7cf_steps\" value=\"{}\" \/><input type=\"hidden\" name=\"_wpcf7cf_options\" value=\"{&quot;form_id&quot;:25556853,&quot;conditions&quot;:[],&quot;settings&quot;:{&quot;animation&quot;:&quot;yes&quot;,&quot;animation_intime&quot;:200,&quot;animation_outtime&quot;:200,&quot;conditions_ui&quot;:&quot;normal&quot;,&quot;notice_dismissed&quot;:false,&quot;notice_dismissed_update-cf7-5.9.8&quot;:true,&quot;notice_dismissed_update-cf7-6.1.1&quot;:true}}\" \/>\n<\/fieldset>\n<p><span class=\"wpcf7-form-control-wrap\" data-name=\"full_name\"><input size=\"40\" maxlength=\"400\" class=\"wpcf7-form-control wpcf7-text wpcf7-validates-as-required\" aria-required=\"true\" aria-invalid=\"false\" placeholder=\"Name\" value=\"\" type=\"text\" name=\"full_name\" \/><\/span><br \/>\n<span class=\"wpcf7-form-control-wrap\" data-name=\"phone\"><input size=\"40\" maxlength=\"400\" class=\"wpcf7-form-control wpcf7-tel wpcf7-validates-as-required wpcf7-text wpcf7-validates-as-tel\" aria-required=\"true\" aria-invalid=\"false\" placeholder=\"Phone\" value=\"\" type=\"tel\" name=\"phone\" \/><\/span><br \/>\n<span class=\"wpcf7-form-control-wrap\" data-name=\"email_id\"><input size=\"40\" maxlength=\"400\" class=\"wpcf7-form-control wpcf7-email wpcf7-text wpcf7-validates-as-email\" aria-invalid=\"false\" placeholder=\"Email\" value=\"\" type=\"email\" name=\"email_id\" \/><\/span><br \/>\n<span class=\"wpcf7-form-control-wrap\" data-name=\"language\"><select class=\"wpcf7-form-control wpcf7-select wpcf7-validates-as-required\" aria-required=\"true\" aria-invalid=\"false\" name=\"language\"><option value=\"\">Language<\/option><option value=\"Malayalam\">Malayalam<\/option><option value=\"Tamil\">Tamil<\/option><option value=\"Telugu\">Telugu<\/option><option value=\"Kannada\">Kannada<\/option><option value=\"Hindi\">Hindi<\/option><\/select><\/span><br \/>\n<span class=\"wpcf7-form-control-wrap\" data-name=\"course\"><select class=\"wpcf7-form-control wpcf7-select wpcf7-validates-as-required course-field-select\" aria-required=\"true\" aria-invalid=\"false\" name=\"course\"><option value=\"\">Upskill in<\/option><option value=\"Commerce\">Commerce<\/option><option value=\"Coding\">Coding<\/option><option value=\"Robotics &amp; AI Course\">Robotics &amp; AI Course<\/option><option value=\"Stock Market Course\">Stock Market Course<\/option><option value=\"Spoken English\">Spoken English<\/option><option value=\"German Language\">German Language<\/option><option value=\"Montessori Teacher Training\">Montessori Teacher Training<\/option><option value=\"IELTS\">IELTS<\/option><option value=\"OET\">OET<\/option><option value=\"MEP\">MEP<\/option><option value=\"Embedded System Software Engineering\">Embedded System Software Engineering<\/option><option value=\"Quantity Surveying\">Quantity Surveying<\/option><option value=\"Hospital and Healthcare Administration\">Hospital and Healthcare Administration<\/option><option value=\"Yoga TTC\">Yoga TTC<\/option><option value=\"Digital Marketing\">Digital Marketing<\/option><option value=\"AI for Teachers\">AI for Teachers<\/option><option value=\"Arabic\">Arabic<\/option><\/select><\/span>\n<\/p>\n<div data-id=\"group-coding\" data-orig_data_id=\"group-coding\" data-clear_on_hide class=\"\" data-class=\"wpcf7cf_group\">\n\t<p><span class=\"wpcf7-form-control-wrap\" data-name=\"course_name\"><select class=\"wpcf7-form-control wpcf7-select wpcf7-validates-as-required course-name-select\" aria-required=\"true\" aria-invalid=\"false\" name=\"course_name\"><option value=\"\">Select Course<\/option><option value=\"Full Stack Development\">Full Stack Development<\/option><option value=\"Data Science and ML\">Data Science and ML<\/option><option value=\"Software Testing\">Software Testing<\/option><option value=\"Python Programming\">Python Programming<\/option><option value=\"AWS Training\">AWS Training<\/option><\/select><\/span>\n\t<\/p>\n<\/div>\n<div data-id=\"group-accounting\" data-orig_data_id=\"group-accounting\" data-clear_on_hide class=\"\" data-class=\"wpcf7cf_group\">\n\t<p><span class=\"wpcf7-form-control-wrap\" data-name=\"course_name\"><select class=\"wpcf7-form-control wpcf7-select wpcf7-validates-as-required course-name-select\" aria-required=\"true\" aria-invalid=\"false\" name=\"course_name\"><option value=\"\">Select Course<\/option><option value=\"Business Accounting\">Business Accounting<\/option><option value=\"CMA USA\">CMA USA<\/option><option value=\"Enrolled Agent\">Enrolled Agent<\/option><option value=\"SAP FICO\">SAP FICO<\/option><option value=\"SAP MM\">SAP MM<\/option><option value=\"SAP SD\">SAP SD<\/option><option value=\"ACCA\">ACCA<\/option><option value=\"Tally\">Tally<\/option><option value=\"UAE Accounting\">UAE Accounting<\/option><option value=\"GST\">GST<\/option><\/select><\/span>\n\t<\/p>\n<\/div>\n<p><span class=\"wpcf7-form-control-wrap\" data-name=\"education\"><input size=\"40\" maxlength=\"400\" class=\"wpcf7-form-control wpcf7-text wpcf7-validates-as-required\" aria-required=\"true\" aria-invalid=\"false\" placeholder=\"Educational qualification\" value=\"\" type=\"text\" name=\"education\" \/><\/span>\n<\/p>\n<div style=\"display:none\">\n<input class=\"wpcf7-form-control wpcf7-hidden course-name-input\" value=\"\" type=\"hidden\" name=\"course_name\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden utm-source\" value=\"\" type=\"hidden\" name=\"utm_source\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden utm-medium\" value=\"\" type=\"hidden\" name=\"utm_medium\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden utm-campaign\" value=\"\" type=\"hidden\" name=\"utm_campaign\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden utm-content\" value=\"\" type=\"hidden\" name=\"utm_content\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden utm-term\" value=\"\" type=\"hidden\" name=\"utm_term\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden blog-url\" value=\"\" type=\"hidden\" name=\"blog_url\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden post-category-name\" value=\"\" type=\"hidden\" name=\"post_category_name\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden post-author-name\" value=\"\" type=\"hidden\" name=\"post_author_name\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden file-url\" value=\"\" type=\"hidden\" name=\"file_url\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden video-url\" value=\"\" type=\"hidden\" name=\"video_url\" \/>\n<input class=\"wpcf7-form-control wpcf7-hidden courseid\" value=\"\" type=\"hidden\" name=\"course_id\" \/>\n<\/div>\n<div class=\"cf7-cf-turnstile\" style=\"margin-top: 0px; margin-bottom: -15px;\"> <div id=\"cf-turnstile-cf7-3530305290\" class=\"cf-turnstile\" data-sitekey=\"0x4AAAAAABVigxtkiZeGTu5L\" data-theme=\"light\" data-language=\"auto\" data-size=\"normal\" data-retry=\"auto\" data-retry-interval=\"1000\" data-action=\"contact-form-7\" data-appearance=\"always\"><\/div> <script>document.addEventListener(\"DOMContentLoaded\", function() { setTimeout(function(){ var e=document.getElementById(\"cf-turnstile-cf7-3530305290\"); e&&!e.innerHTML.trim()&&(turnstile.remove(\"#cf-turnstile-cf7-3530305290\"), turnstile.render(\"#cf-turnstile-cf7-3530305290\", {sitekey:\"0x4AAAAAABVigxtkiZeGTu5L\"})); }, 0); });<\/script> <br class=\"cf-turnstile-br cf-turnstile-br-cf7-3530305290\"> <style>#cf-turnstile-cf7-3530305290 { margin-left: -15px; }<\/style> <script>document.addEventListener(\"DOMContentLoaded\",function(){document.querySelectorAll('.wpcf7-form').forEach(function(e){e.addEventListener('submit',function(){if(document.getElementById('cf-turnstile-cf7-3530305290')){setTimeout(function(){turnstile.reset('#cf-turnstile-cf7-3530305290');},1000)}})})});<\/script> <\/div><br\/><input class=\"wpcf7-form-control wpcf7-submit has-spinner\" type=\"submit\" value=\"Submit\" \/>\n<\/p><div class=\"wpcf7-response-output\" aria-hidden=\"true\"><\/div>\n<\/form>\n<\/div>\n\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>A machine learning model can quickly become overfitted or under fitted during training. To prevent this, we properly fit a model onto our test set using regularisation in machine learning. Regularization methods aid in obtaining the best model by lowering the likelihood of overfitting. What Are Overfitting and Underfitting? We provide some data for our [&hellip;]<\/p>\n","protected":false},"author":93,"featured_media":25548342,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[802,1864,1882,1883,1881],"tags":[],"class_list":["post-25548341","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-articles","category-data-science-ml","category-java-programming","category-react-native","category-web-android-development"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>What is Regularization in Machine Learning? - Entri Blog<\/title>\n<meta name=\"description\" content=\"The Best Guide to Regularization in Machine Learning, we observed how bias and variance function in model optimization. And several regularisation strategies to combat over and under-fitting. Finally, a demo showed us how to apply regularisation in Python.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What is Regularization in Machine Learning? - Entri Blog\" \/>\n<meta property=\"og:description\" content=\"The Best Guide to Regularization in Machine Learning, we observed how bias and variance function in model optimization. And several regularisation strategies to combat over and under-fitting. Finally, a demo showed us how to apply regularisation in Python.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"Entri Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/entri.me\/\" \/>\n<meta property=\"article:published_time\" content=\"2022-11-27T07:23:27+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-24T07:53:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"820\" \/>\n\t<meta property=\"og:image:height\" content=\"615\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Akhil M G\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@entri_app\" \/>\n<meta name=\"twitter:site\" content=\"@entri_app\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Akhil M G\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/\"},\"author\":{\"name\":\"Akhil M G\",\"@id\":\"https:\/\/entri.app\/blog\/#\/schema\/person\/875646423b2cce93c1bd5bc16850fff6\"},\"headline\":\"What is Regularization in Machine Learning?\",\"datePublished\":\"2022-11-27T07:23:27+00:00\",\"dateModified\":\"2023-05-24T07:53:53+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/\"},\"wordCount\":1678,\"commentCount\":5,\"publisher\":{\"@id\":\"https:\/\/entri.app\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png\",\"articleSection\":[\"Articles\",\"Data Science and Machine Learning\",\"Java Programming\",\"React Native\",\"Web and Android Development\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/\",\"url\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/\",\"name\":\"What is Regularization in Machine Learning? - Entri Blog\",\"isPartOf\":{\"@id\":\"https:\/\/entri.app\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png\",\"datePublished\":\"2022-11-27T07:23:27+00:00\",\"dateModified\":\"2023-05-24T07:53:53+00:00\",\"description\":\"The Best Guide to Regularization in Machine Learning, we observed how bias and variance function in model optimization. And several regularisation strategies to combat over and under-fitting. Finally, a demo showed us how to apply regularisation in Python.\",\"breadcrumb\":{\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#primaryimage\",\"url\":\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png\",\"contentUrl\":\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png\",\"width\":820,\"height\":615,\"caption\":\"What is Regularization in Machine Learning?\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/entri.app\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Entri Skilling\",\"item\":\"https:\/\/entri.app\/blog\/category\/entri-skilling\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Data Science and Machine Learning\",\"item\":\"https:\/\/entri.app\/blog\/category\/entri-skilling\/data-science-ml\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"What is Regularization in Machine Learning?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/entri.app\/blog\/#website\",\"url\":\"https:\/\/entri.app\/blog\/\",\"name\":\"Entri Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/entri.app\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/entri.app\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/entri.app\/blog\/#organization\",\"name\":\"Entri App\",\"url\":\"https:\/\/entri.app\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/entri.app\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2019\/10\/Entri-Logo-1.png\",\"contentUrl\":\"https:\/\/entri.app\/blog\/wp-content\/uploads\/2019\/10\/Entri-Logo-1.png\",\"width\":989,\"height\":446,\"caption\":\"Entri App\"},\"image\":{\"@id\":\"https:\/\/entri.app\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/entri.me\/\",\"https:\/\/x.com\/entri_app\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/entri.app\/blog\/#\/schema\/person\/875646423b2cce93c1bd5bc16850fff6\",\"name\":\"Akhil M G\",\"url\":\"https:\/\/entri.app\/blog\/author\/akhil\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What is Regularization in Machine Learning? - Entri Blog","description":"The Best Guide to Regularization in Machine Learning, we observed how bias and variance function in model optimization. And several regularisation strategies to combat over and under-fitting. Finally, a demo showed us how to apply regularisation in Python.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/","og_locale":"en_US","og_type":"article","og_title":"What is Regularization in Machine Learning? - Entri Blog","og_description":"The Best Guide to Regularization in Machine Learning, we observed how bias and variance function in model optimization. And several regularisation strategies to combat over and under-fitting. Finally, a demo showed us how to apply regularisation in Python.","og_url":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/","og_site_name":"Entri Blog","article_publisher":"https:\/\/www.facebook.com\/entri.me\/","article_published_time":"2022-11-27T07:23:27+00:00","article_modified_time":"2023-05-24T07:53:53+00:00","og_image":[{"width":820,"height":615,"url":"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png","type":"image\/png"}],"author":"Akhil M G","twitter_card":"summary_large_image","twitter_creator":"@entri_app","twitter_site":"@entri_app","twitter_misc":{"Written by":"Akhil M G","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#article","isPartOf":{"@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/"},"author":{"name":"Akhil M G","@id":"https:\/\/entri.app\/blog\/#\/schema\/person\/875646423b2cce93c1bd5bc16850fff6"},"headline":"What is Regularization in Machine Learning?","datePublished":"2022-11-27T07:23:27+00:00","dateModified":"2023-05-24T07:53:53+00:00","mainEntityOfPage":{"@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/"},"wordCount":1678,"commentCount":5,"publisher":{"@id":"https:\/\/entri.app\/blog\/#organization"},"image":{"@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png","articleSection":["Articles","Data Science and Machine Learning","Java Programming","React Native","Web and Android Development"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/","url":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/","name":"What is Regularization in Machine Learning? - Entri Blog","isPartOf":{"@id":"https:\/\/entri.app\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#primaryimage"},"image":{"@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png","datePublished":"2022-11-27T07:23:27+00:00","dateModified":"2023-05-24T07:53:53+00:00","description":"The Best Guide to Regularization in Machine Learning, we observed how bias and variance function in model optimization. And several regularisation strategies to combat over and under-fitting. Finally, a demo showed us how to apply regularisation in Python.","breadcrumb":{"@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#primaryimage","url":"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png","contentUrl":"https:\/\/entri.app\/blog\/wp-content\/uploads\/2022\/11\/Untitled-2022-11-27T124920.783-1.png","width":820,"height":615,"caption":"What is Regularization in Machine Learning?"},{"@type":"BreadcrumbList","@id":"https:\/\/entri.app\/blog\/what-is-regularization-in-machine-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/entri.app\/blog\/"},{"@type":"ListItem","position":2,"name":"Entri Skilling","item":"https:\/\/entri.app\/blog\/category\/entri-skilling\/"},{"@type":"ListItem","position":3,"name":"Data Science and Machine Learning","item":"https:\/\/entri.app\/blog\/category\/entri-skilling\/data-science-ml\/"},{"@type":"ListItem","position":4,"name":"What is Regularization in Machine Learning?"}]},{"@type":"WebSite","@id":"https:\/\/entri.app\/blog\/#website","url":"https:\/\/entri.app\/blog\/","name":"Entri Blog","description":"","publisher":{"@id":"https:\/\/entri.app\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/entri.app\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/entri.app\/blog\/#organization","name":"Entri App","url":"https:\/\/entri.app\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/entri.app\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/entri.app\/blog\/wp-content\/uploads\/2019\/10\/Entri-Logo-1.png","contentUrl":"https:\/\/entri.app\/blog\/wp-content\/uploads\/2019\/10\/Entri-Logo-1.png","width":989,"height":446,"caption":"Entri App"},"image":{"@id":"https:\/\/entri.app\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/entri.me\/","https:\/\/x.com\/entri_app"]},{"@type":"Person","@id":"https:\/\/entri.app\/blog\/#\/schema\/person\/875646423b2cce93c1bd5bc16850fff6","name":"Akhil M G","url":"https:\/\/entri.app\/blog\/author\/akhil\/"}]}},"_links":{"self":[{"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/posts\/25548341","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/users\/93"}],"replies":[{"embeddable":true,"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/comments?post=25548341"}],"version-history":[{"count":6,"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/posts\/25548341\/revisions"}],"predecessor-version":[{"id":25560552,"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/posts\/25548341\/revisions\/25560552"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/media\/25548342"}],"wp:attachment":[{"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/media?parent=25548341"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/categories?post=25548341"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entri.app\/blog\/wp-json\/wp\/v2\/tags?post=25548341"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}