Image

Kanishka Bhaduri

Member since: Sep 24, 2010, Mission Critical Technologies Inc

Multivariate Time Series Search

An algorithm shared by Kanishka Bhaduri, updated on Aug 15, 2011

Summary

resource_image
Contributing Author(s) :
Kanishka Bhaduri , Q. Zhu, Nikunj Oza , Ashok Srivastava

Multivariate Time-Series (MTS) are ubiquitous, and are generated in areas as disparate as sensor recordings in aerospace systems, music and video streams, medical monitoring, and financial systems. Domain experts are often interested in searching for interesting multivariate patterns from these MTS databases which can contain up to several gigabytes of data. Surprisingly, research on MTS search is very limited. Most existing work only supports queries with the same length of data, or queries on a fixed set of variables. In this paper, we propose an efficient and flexible subsequence search framework for massive MTS databases, that, for the first time, enables querying on any subset of variables with arbitrary time delays between them. We propose two provably correct algorithms to solve this problem — (1) an R-tree Based Search (RBS) which uses Minimum Bounding Rectangles (MBR) to organize the subsequences, and (2) a List Based Search (LBS) algorithm which uses sorted lists for indexing. We demonstrate the performance of these algorithms using two large MTS databases from the aviation domain, each containing several millions of observations. Both these tests show that our algorithms have very high prune rates (>95%) thus needing actual disk access for only less than 5% of the observations. To the best of our knowledge, this is the first flexible MTS search algorithm capable of subsequence search on any subset of variables. Moreover, MTS subsequence search has never been attempted on datasets of the size we have used in this paper.

show more info
Operating System
Lunux, windows, mac (edit)
License
NASA OPEN SOURCE AGREEMENT (edit)
Programming Language
Matlab (edit)
Version
N/A (edit)

Source Files

MTS_Search.zip
Source code
1.9 MB 125 downloads

Support/Documentation (edit)

For any questions, contact this resource's administrator: NDC-kbhaduri

Discussions

Add New Comment

Kanishka's Projects (4)

Need help?

Visit our help center