Random Forests and Kernel Methods - Sorbonne Université Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Information Theory Année : 2016

Random Forests and Kernel Methods

Résumé

Random forests are ensemble methods which grow trees as base learners and combine their predictions by averaging. Random forests are known for their good practical performance, particularly in high-dimensional settings. On the theoretical side, several studies highlight the potentially fruitful connection between random forests and kernel methods. In this paper, we work out in full details this connection. In particular, we show that by slightly modifying their definition, random forests can be rewritten as kernel methods (called KeRF for Kernel based on Random Forests) which are more interpretable and easier to analyze. Explicit expressions of KeRF estimates for some specific random forest models are given, together with upper bounds on their rate of consistency. We also show empirically that KeRF estimates compare favourably to random forest estimates.

Dates et versions

hal-01255002 , version 1 (13-01-2016)

Identifiants

Citer

Erwan Scornet. Random Forests and Kernel Methods. IEEE Transactions on Information Theory, 2016, PP (99), pp.1-1. ⟨10.1109/TIT.2016.2514489⟩. ⟨hal-01255002⟩
73 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More