An ultra-fast time series distance measure to allow data mining in more complex real-world deployments

Gharghabi, Shaghayegh, Imani, Shima, Bagnall, Anthony, Darvishzadeh, Amirali and Keogh, Eamonn (2020) An ultra-fast time series distance measure to allow data mining in more complex real-world deployments. Data Mining and Knowledge Discovery, 34 (4). 1104–1135. ISSN 1384-5810

[thumbnail of ultra fast]
Preview
PDF (ultra fast) - Accepted Version
Download (1MB) | Preview

Abstract

At their core, many time series data mining algorithms reduce to reasoning about the shapes of time series subsequences. This requires an effective distance measure, and for last two decades most algorithms use Euclidean Distance or DTW as their core subroutine. We argue that these distance measures are not as robust as the community seems to believe. The undue faith in these measures perhaps derives from an overreliance on the benchmark datasets and self-selection bias. The community is simply reluctant to address more difficult domains, for which current distance measures are ill-suited. In this work, we introduce a novel distance measure MPdist. We show that our proposed distance measure is much more robust than current distance measures. For example, it can handle data with missing values or spurious regions. Furthermore, it allows us to successfully mine datasets that would defeat any Euclidean or DTW distance-based algorithm. Additionally, we show that our distance measure can be computed so efficiently as to allow analytics on very fast arriving streams.

Item Type: Article
Uncontrolled Keywords: time series,distance measure,matrix profile
Faculty \ School: Faculty of Science > School of Computing Sciences
UEA Research Groups: Faculty of Science > Research Groups > Data Science and Statistics
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 23 May 2020 00:07
Last Modified: 22 Oct 2022 06:13
URI: https://ueaeprints.uea.ac.uk/id/eprint/75300
DOI: 10.1007/s10618-020-00695-8

Actions (login required)

View Item View Item