On diversity and accuracy of homogeneous and heterogeneous ensembles

Bian, Shun and Wang, Wenjia (2007) On diversity and accuracy of homogeneous and heterogeneous ensembles. International Journal of Hybrid Intelligent Systems, 4 (2). pp. 103-128. ISSN 1448-5869

Full text not available from this repository. (Request a copy)

Abstract

The ensemble learning approach has been increasingly used in data mining for improving performance. However, the gain on the learning performance appears varying considerably from application to application. In some cases there were little or no gains achieved even when the same ensemble paradigms were used. This means that there are still some problems in understanding some basic and fundamental issues in ensemble methodology, especially on the factors that can affect the performance of an ensemble and the strategies for constructing effective ensembles. This paper attempts to address these issues. It first describes the possible influencing factors and then focuses on investigating the most important factor – diversity and its relationships with the accuracy of ensemble. In this study, two types of ensembles – homogeneous and heterogeneous ensembles are defined and constructed by using ten different learning algorithms and their diversity and accuracy are evaluated in order to find out which types of ensemble possess high diversity and are thus more accurate. For each of the ten learning algorithms, its ability for generating different types of diversity is estimated quantitatively by using ten common diversity measures and their characteristics are then analyzed to establish their correlation with ensemble performance. The study used fifteen popular data sets to verify the consistence and reliability of our experimental findings.

Item Type: Article
Faculty \ School: Faculty of Science > School of Computing Sciences

UEA Research Groups: Faculty of Science > Research Groups > Data Science and Statistics
Related URLs:
Depositing User: Vishal Gautam
Date Deposited: 04 Apr 2011 13:15
Last Modified: 11 Sep 2023 14:30
URI: https://ueaeprints.uea.ac.uk/id/eprint/22183
DOI:

Actions (login required)

View Item View Item