Experimental study for the comparison of classifier combination methods

S. Y. Sohn, H. W. Shin

Research output: Contribution to journalArticlepeer-review

23 Citations (Scopus)


In this paper, we compare the performances of classifier combination methods (bagging, modified random subspace method, classifier selection, parametric fusion) to logistic regression in consideration of various characteristics of input data. Four factors used to simulate the logistic model are: (a) combination function among input variables, (b) correlation between input variables, (c) variance of observation, and (d) training data set size. In view of typically unknown combination function among input variables, we use a Taguchi design to improve the practicality of our study results by letting it as an uncontrollable factor. Our experimental study results indicate the following: when training set size is large, performances of logistic regression and bagging are not significantly different. However, when training set size is small, the performance of logistic regression is worse than bagging. When training data set size is small and correlation is strong, both modified random subspace method and bagging perform better than the other three methods. When correlation is weak and variance is small, both parametric fusion and classifier selection algorithm appear to be the worst at our disappointment.

Original languageEnglish
Pages (from-to)33-40
Number of pages8
JournalPattern Recognition
Issue number1
Publication statusPublished - 2007 Jan

Bibliographical note

Funding Information:
This work was supported by Grant No. (R04-2002-000-20003-0) from the Basic Research Program of the Korea Science & Engineering Foundation.

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'Experimental study for the comparison of classifier combination methods'. Together they form a unique fingerprint.

Cite this