A Comparative Study of Ridge, LASSO and Elastic net Estimators

It appears your Web browser is not configured to display PDF files. Download adobe Acrobat or click here to download the PDF file.

Click here to download the PDF file.

Creator: 

Al Dabal, Meaad Abdullah A.

Date: 

2021

Abstract: 

The focus of this thesis is to review the three basic penalty estimators, namely, ridge regression estimator, LASSO, and elastic net estimator in the light of the deficiencies of least-squares estimator. Ill-conditioned design matrix is the major source of problem in this case. To overcome this problem, ridge regression was developed, and it opened the door for penalty estimators. Its impact is visible with various linear and non-linear models. A superb discovery in the class of subset selection is the LASSO (Least Absolute Shrinkage and Selection Operator) which selects subsets and estimates the coefficients simultaneously. Finally, we consider the elastic net penalty estimator which combine the L$_{1}$\ and L$_{2}$\ penalty function. Resulting estimator is weighted LASSO by ridge factor. We obtain the L$_{2}$-risk expressions and compare with pre-test and Stein-type estimators.

Subject: 

Statistics

Language: 

English

Publisher: 

Carleton University

Thesis Degree Name: 

Master of Science: 
M.Sc.

Thesis Degree Level: 

Master's

Thesis Degree Discipline: 

Statistics

Parent Collection: 

Theses and Dissertations

Items in CURVE are protected by copyright, with all rights reserved, unless otherwise indicated. They are made available with permission from the author(s).