Start Submission Become a Reviewer

Reading: Implementation of adaptive lasso regression based on multiple Theil-Sen Estimators using dif...

Download

A- A+
Alt. Display

Research Articles

Implementation of adaptive lasso regression based on multiple Theil-Sen Estimators using differential evolution algorithm with heavy tailed errors

Authors:

E. Dünder ,

Ondokuz Mayıs University, TR
About E.
Department of Statistics
X close

T. Zaman,

Çankırı Karatekin University, TR
About T.
Department of Statistics
X close

M.A. Cengiz,

Ondokuz Mayıs University, TR
About M.A.
Department of Statistics
X close

K. Alakuş

Ondokuz Mayıs University, TR
About K.
Department of Statistics
X close

Abstract

The last decade has witnessed that penalized regression methods have become an alternative to classical methods. Adaptive lasso is one type of method in penalized regression and is commonly used in statistical modelling to perform variable selection. Apart from the classical lasso setting, the adaptive lasso requires the coefficient weights inside the target function. The main issue in adaptive lasso is to select the optimal weights in the model since the selected weights have serious impacts on the estimation results. However, there is no compromise for choosing the weights as a universal approach, and they should be chosen properly with the statistical assumptions. When the error terms are heavytailed, classical estimation (such as least squares) gives poor results in adaptive lasso because of the lacking robustness. This article deals with the selection of optimal weights in the presence of heavy-tailed errors for the adaptive lasso. To solve the distributional problem, we integrated the Theil-Sen estimation (TSE) approach into the adaptive lasso for heavytailed erroneous cases while choosing the weights. During the selection of the optimal tuning parameters, we employed a differential evolution algorithm (DEA) between a range of lambda values. The simulation studies and real data examples confirm the power of our combination of Theil-Sen estimators and differential evolution algorithm in the presence of heavytailed errors in the adaptive lasso.

How to Cite: Dünder, E., Zaman, T., Cengiz, M.A. and Alakuş, K., 2022. Implementation of adaptive lasso regression based on multiple Theil-Sen Estimators using differential evolution algorithm with heavy tailed errors. Journal of the National Science Foundation of Sri Lanka, 50(2), pp.395–404. DOI: http://doi.org/10.4038/jnsfsr.v50i2.10292
Published on 09 Sep 2022.
Peer Reviewed

Downloads

  • PDF (EN)

    comments powered by Disqus