Boosting the minimum margin: LPBoost vs. AdaBoost

Abstract

LPBoost seemingly should have better generalization capability than AdaBoost according to the margin theory (Schapire, 1999) because LPBoost optimizes the minimum margin directly. Thus far, however, there is no empirical comparison and theoretical explanation of LPBoost against AdaBoost. We have conducted an experimental evaluation on the classification performance of LPBoost and AdaBoost in this paper. Our results show that the LPBoost performs worse than AdaBoost in most cases. By considering the margin distribution, we present an explanation. Also, our finding indicates that besides the minimum margin, which is directly and globally optimized in LPBoost, the margin distribution plays a more important role in terms of the learned strong classifierpsilas classification performance.