Abstract
Background: Variable selection is a central challenge in logistic regression, particularly in high-dimensional biomedical applications where correlated predictors and limited sample sizes complicate reliable identification of relevant variables. This study aims to systematically compare three widely used variable selection approaches - Boruta, LASSO, and Elastic Net - under a range of data-generating conditions and to illustrate their performance using an ovarian cancer miRNA dataset. Methods: We conducted a simulation study across 36 logistic regression scenarios varying in sample size, dimensionality, predictor correlation, and effect magnitude. Performance was evaluated using true-positive and false-positive selection rates. In addition, all three methods were applied to a real-world serum miRNA expression dataset, and discriminative performance was assessed using the area under the receiver operating characteristic curve (AUC). Results: Boruta, Elastic Net, and LASSO exhibited distinct variable selection behaviors across simulation scenarios. Boruta maintained strong true-positive recovery while controlling false positives in most settings, particularly when predictors were highly correlated. Elastic Net consistently achieved high sensitivity but produced comparatively large false-positive rates. LASSO showed the most conservative behavior, recovering fewer true predictors while maintaining low false-positive rates across nearly all scenarios. In the ovarian cancer miRNA application, all three methods achieved similarly strong test-set AUC performance, despite marked differences in the size of the selected biomarker panels. Conclusions: The results demonstrate clear trade-offs among the three methods. Boruta offers a favorable balance between sensitivity and specificity in highly correlated settings. Elastic Net prioritizes sensitivity at the cost of increased false discoveries, whereas LASSO provides stricter false-positive control with reduced sensitivity. These findings offer practical guidance for selecting variable selection methods in logistic regression, particularly for high-dimensional biomedical applications.
| Original language | English |
|---|---|
| Article number | 196 |
| Number of pages | 14 |
| Journal | BMC Medical Research Methodology |
| Volume | 26 |
| Issue number | 1 |
| DOIs | |
| Publication status | Published - Dec 2026 |
Bibliographical note
Publisher Copyright:© The Author(s) 2026.
UN SDGs
This output contributes to the following UN Sustainable Development Goals (SDGs)
-
SDG 3 Good Health and Well-being
Keywords
- Boruta
- Elastic Net
- High-dimensional data
- LASSO
- Logistic regression
- miRNA
- Simulation study
- Variable selection
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver