Statistics to measure correlation for data mining applications

Rayward-Smith, V. J. (2007) Statistics to measure correlation for data mining applications. Computational Statistics and Data Analysis, 51 (8). pp. 3968-3982. ISSN 0167-9473

Full text not available from this repository. (Request a copy)

Abstract

Correlation is usually used in the context of real-valued sequences but, in data mining, the values of fields may be of various types—real, nominal or ordinal. Techniques for measuring correlation between any two sequences of data are reviewed, regardless of their type. In particular, a new technique for measuring the correlation between real-valued data and nominal data is proposed. The technique relies on the definition of an assignment of the nominal values to real values and hence is called A-correlation (A for assignment). The proposed assignment is defined to be the most favourable of all such assignments and can be efficiently computed. Moreover, it is shown that the resulting correlation coefficient has a natural interpretation independent of the assignment. With nominal/nominal data, Cramer's V-statistic can be used or, alternatively, a new statistic based on matching. These can also be used in the ordinal/nominal case. With just ordinal data, correlations based on rank are appropriate and these can also be used in the ordinal/ordinal and the ordinal/real cases.

Item Type:	Article
Faculty \ School:	Faculty of Science > School of Computing Sciences
Depositing User:	EPrints Services
Date Deposited:	01 Oct 2010 13:41
Last Modified:	30 Jan 2023 12:30
URI:	https://ueaeprints.uea.ac.uk/id/eprint/3027
DOI:	10.1016/j.csda.2006.05.025

Actions (login required)

View Item