Weighted Heuristic Ensemble of Filters

Aldehim, Ghadah and Wang, Wenjia (2015) Weighted Heuristic Ensemble of Filters. In: SAI Intelligent Systems Conference 2015, 2015-11-10 - 2015-11-11.

[img]
Preview
PDF (Weighted Heuristic Ensemble of Filters_print) - Submitted Version
Download (769kB) | Preview

    Abstract

    Feature selection has become increasingly important in data mining in recent years due to the rapid increase in the dimensionality of big data. However, the reliability and consistency of feature selection methods (filters) vary considerably on different data and no single filter performs consistently well under various conditions. Therefore, feature selection ensemble has been investigated recently to provide more reliable and effective results than any individual one but all the existing feature selection ensemble treat the feature selection methods equally regardless of their performance. In this paper, we present a novel framework which applies weighted feature selection ensemble through proposing a systemic way of adding different weights to the feature selection methods-filters. Also, we investigate how to determine the appropriate weight for each filter in an ensemble. Experiments based on ten benchmark datasets show that theoretically and intuitively adding more weight to ‘good filters’ should lead to better results but in reality it is very uncertain. This assumption was found to be correct for some examples in our experiment. However, for other situations, filters which had been assumed to perform well showed bad performance leading to even worse results. Therefore adding weight to filters might not achieve much in accuracy terms, in addition to increasing complexity, time consumption and clearly decreasing the stability.

    Item Type: Conference or Workshop Item (Paper)
    Uncontrolled Keywords: feature selection,ensemble,classification,stability,heuristics,weight
    Faculty \ School: Faculty of Science > School of Computing Sciences
    University of East Anglia > Faculty of Science > Research Groups > Computational Biology (subgroups are shown below) > Machine learning in computational biology
    ?? RGMLS ??
    Depositing User: Pure Connector
    Date Deposited: 12 Nov 2015 16:01
    Last Modified: 25 Jul 2018 02:12
    URI: https://ueaeprints.uea.ac.uk/id/eprint/55140
    DOI:

    Actions (login required)

    View Item