
The random forest algorithm, proposed by L. Breiman in 2001, has been extremely successful as a general-purpose classification and regression method. The approach, which combines several randomized decision trees and aggregates their predictions by averaging, has shown excellent performance in settings where the number of variables is much larger than the number of observations. Moreover, it is versatile enough to be applied to large-scale problems, is easily adapted to various ad-hoc learning tasks, and returns measures of variable importance. The present article reviews the most recent theoretical and methodological developments for random forests. Emphasis is placed on the mathematical forces driving the algorithm, with special attention given to the selection of parameters, the resampling mechanism, and variable importance measures. This review is intended to provide non-experts easy access to the main ideas.
FOS: Computer and information sciences, Resampling, Variable importance, parameter tuning, Mathematics - Statistics Theory, Machine Learning (stat.ML), Randomization, Statistics Theory (math.ST), randomization, Random forests, resampling, Statistics - Machine Learning, Parameter tuning, variable importance, FOS: Mathematics, [MATH.MATH-ST] Mathematics [math]/Statistics [math.ST]
FOS: Computer and information sciences, Resampling, Variable importance, parameter tuning, Mathematics - Statistics Theory, Machine Learning (stat.ML), Randomization, Statistics Theory (math.ST), randomization, Random forests, resampling, Statistics - Machine Learning, Parameter tuning, variable importance, FOS: Mathematics, [MATH.MATH-ST] Mathematics [math]/Statistics [math.ST]
| citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 3K | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 0.01% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 0.1% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 0.1% |
