arbiter
JournalsAccount

The Performance of Ridge Regression, LASSO, and Elastic-Net in Controlling Multicollinearity: A Simulation and Application

Netti Herawati et al.

Journal of Modern Applied Statistical Methods2024https://doi.org/10.56801/jmasm.v23.i2.4article
ABDC B
Weight
0.74

Abstract

This research aims to compare the performance of Ordinary Least Square (OLS), Least Absolute Shrinkage and Selection Operator (LASSO), Ridge Regression (RR) and Elastic-Net in controlling multicollinearity problems between independent variables in multiple regression analysis using simulation data and case data. Data simulation uses a multiple regression model with p = 6 with a high level of multicollinearity (ρ = 0.99) at several sample sizes (n = 25, 50, 75). The best method is measured based on the smallest Average Mean Square Error (AMSE) and AIC values. The research results show that Elastic-Net is the best method for simulated data compared to LASSO and Ridge because it has the smallest AMSE and AIC values for each sample size studied. Similar things were also obtained when applying these three methods to data on stunting toddler cases in Indonesia which had high multicollinearity. By using the best method, namely the Elastic Net method, real data shows that cases of stunted toddlers in Indonesia are influenced by the percentage of toddlers who are malnourished (????????), the percentage of toddlers who receive exclusive breast milk (????????), the percentage of toddlers whose growth is monitored (????????), coverage of health services for pregnant women (????????), number of nutrition workers (????????), percentage of households with adequate drinking water (????????), percentage of households with adequate sanitation (????????????), human development index (????????????), and population density (????????????).

13 citations

Open via your library →

Cite this paper

https://doi.org/https://doi.org/10.56801/jmasm.v23.i2.4

Or copy a formatted citation

@article{netti2024,
  title        = {{The Performance of Ridge Regression, LASSO, and Elastic-Net in Controlling Multicollinearity: A Simulation and Application}},
  author       = {Netti Herawati et al.},
  journal      = {Journal of Modern Applied Statistical Methods},
  year         = {2024},
  doi          = {https://doi.org/https://doi.org/10.56801/jmasm.v23.i2.4},
}

Paste directly into BibTeX, Zotero, or your reference manager.

Flag this paper

The Performance of Ridge Regression, LASSO, and Elastic-Net in Controlling Multicollinearity: A Simulation and Application

Flags are reviewed by the Arbiter methodology team within 5 business days.

Evidence weight

0.74

Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40

F · citation impact0.98 × 0.4 = 0.39
M · momentum0.82 × 0.15 = 0.12
V · venue signal0.50 × 0.05 = 0.03
R · text relevance †0.50 × 0.4 = 0.20

† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.