Bootstrap method for robust inference
The paper titled, Regression analysis with many specifications, uses stationary bootstrap method to evaluate a large set of models.
In a typical data mining set up, the problem of choosing the number of covariates can be handled in many ways such as
Best subset selection
Forward or/ and backward regression
Forward stage wise regression
Lasso
Ridge regression
Combination of Lasso and Ridge regression