Caprile B., Furlanello C., Merler S.

Exact Bagging with k-Nearest Neighbour Classifiers

ITC-irst, Technical report, June 2001, 7 pp.

Abstract

A formula is exhibited for the exact computation of Bagging classifiers when the base model adopted is k-Nearest Neighbour (k-NN). The formula holds in any dimension, does not require the extraction of bootstrap replicates, and yields an implementation of Bagging that is as fast as the computation of a single k-NN classifier. It also shows that Bagging with 1-Nearest Neighbour is perfectly equivalent to plain 1-NN.