Regularization and Variable Selection Via the Elastic Net
Hui Zou, Trevor J. Hastie · Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2005
Summary We propose the elastic net, a new regularization and variable selection method. Real world data and a simulation study show that the elastic net often outperforms the lasso, while enjoying a similar sparsity of representation. In addition, the elastic net encourages a grouping effect, where strongly correlated predictors tend to be in or out of the model together. The elastic net is particularly useful when the number of predictors (p) is much bigger than the number of observations (n). By contrast, the lasso is not a very satisfactory variable selection method in the p≫n case. An algorithm called LARS-EN is proposed for computing elastic net regularization paths efficiently, much like algorithm LARS does for the lasso.
Cited by 20,820 works. doi:10.1111/j.1467-9868.2005.00503.x Open-access PDF
Authors
References
- Matrix Computations
- Regression Shrinkage and Selection Via the Lasso
- Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring
- The Elements of Statistical Learning: Data Mining, Inference, and Prediction
- Least angle regression
- In silico prediction of protein-protein interactions in human macrophages
- Significance analysis of microarrays applied to the ionizing radiation response
- The Elements of Statistical Learning: Data Mining, Inference, and Prediction
- Gene Selection for Cancer Classification using Support Vector Machines
- Wavelet Shrinkage: Asymptopia?