Weighted Heuristic Ensemble of Filters

Aldehim, Ghadah and Wang, Wenjia (2015) Weighted Heuristic Ensemble of Filters. In: SAI Intelligent Systems Conference 2015, 2015-11-10 - 2015-11-11.

Preview

PDF (Weighted Heuristic Ensemble of Filters_print) - Accepted Version Download (788kB) | Preview

Abstract

Feature selection has become increasingly important in data mining in recent years due to the rapid increase in the dimensionality of big data. However, the reliability and consistency of feature selection methods (filters) vary considerably on different data and no single filter performs consistently well under various conditions. Therefore, feature selection ensemble has been investigated recently to provide more reliable and effective results than any individual one but all the existing feature selection ensemble treat the feature selection methods equally regardless of their performance. In this paper, we present a novel framework which applies weighted feature selection ensemble through proposing a systemic way of adding different weights to the feature selection methods-filters. Also, we investigate how to determine the appropriate weight for each filter in an ensemble. Experiments based on ten benchmark datasets show that theoretically and intuitively adding more weight to ‘good filters’ should lead to better results but in reality it is very uncertain. This assumption was found to be correct for some examples in our experiment. However, for other situations, filters which had been assumed to perform well showed bad performance leading to even worse results. Therefore adding weight to filters might not achieve much in accuracy terms, in addition to increasing complexity, time consumption and clearly decreasing the stability.

Item Type:	Conference or Workshop Item (Paper)
Uncontrolled Keywords:	feature selection,ensemble,classification,stability,heuristics,weight
Faculty \ School:	Faculty of Science > School of Computing Sciences
UEA Research Groups:	Faculty of Science > Research Groups > Data Science and Statistics
Depositing User:	Pure Connector
Date Deposited:	12 Nov 2015 16:01
Last Modified:	21 Oct 2022 02:30
URI:	https://ueaeprints.uea.ac.uk/id/eprint/55140
DOI:

Downloads

Actions (login required)

View Item