A Novel Long- and Short-Term Memory Network with Time Series Data Analysis Capabilities

Time series data are an extremely important type of data in the real world. Time series data gradually accumulate over time. Due to the dynamic growth in time series data, they tend to have higher dimensions and large data scales. When performing cluster analysis on this type of data, there are shor...

Full description

Bibliographic Details
Main Authors: Mu Qiao, Zixuan Cheng
Format: Article
Language:English
Published: Hindawi Limited 2020-01-01
Series:Mathematical Problems in Engineering
Online Access:http://dx.doi.org/10.1155/2020/8885625
id doaj-e3e4ff1ccce44b76bdd36bfeb51566a5
record_format Article
spelling doaj-e3e4ff1ccce44b76bdd36bfeb51566a52020-11-25T04:08:30ZengHindawi LimitedMathematical Problems in Engineering1024-123X1563-51472020-01-01202010.1155/2020/88856258885625A Novel Long- and Short-Term Memory Network with Time Series Data Analysis CapabilitiesMu Qiao0Zixuan Cheng1School of Mathematics, Jilin University, Changchun 130021, ChinaSchool of Electronic and Information Engineering, Changchun University, Changchun 130022, ChinaTime series data are an extremely important type of data in the real world. Time series data gradually accumulate over time. Due to the dynamic growth in time series data, they tend to have higher dimensions and large data scales. When performing cluster analysis on this type of data, there are shortcomings in using traditional feature extraction methods for processing. To improve the clustering performance on time series data, this study uses a recurrent neural network (RNN) to train the input data. First, an RNN called the long short-term memory (LSTM) network is used to extract the features of time series data. Second, pooling technology is used to reduce the dimensionality of the output features in the last layer of the LSTM network. Due to the long time series, the hidden layer in the LSTM network cannot remember the information at all times. As a result, it is difficult to obtain a compressed representation of the global information in the last layer. Therefore, it is necessary to combine the information from the previous hidden unit to supplement all of the data. By stacking all the hidden unit information and performing a pooling operation, a dimensionality reduction effect of the hidden unit information is achieved. In this way, the memory loss caused by an excessively long sequence is compensated. Finally, considering that many time series data are unbalanced data, the unbalanced K-means (UK-means) algorithm is used to cluster the features after dimensionality reduction. The experiments were conducted on multiple publicly available time series datasets. The experimental results show that LSTM-based feature extraction combined with the dimensionality reduction processing of the pooling technology and cluster processing for imbalanced data used in this study has a good effect on the processing of time series data.http://dx.doi.org/10.1155/2020/8885625
collection DOAJ
language English
format Article
sources DOAJ
author Mu Qiao
Zixuan Cheng
spellingShingle Mu Qiao
Zixuan Cheng
A Novel Long- and Short-Term Memory Network with Time Series Data Analysis Capabilities
Mathematical Problems in Engineering
author_facet Mu Qiao
Zixuan Cheng
author_sort Mu Qiao
title A Novel Long- and Short-Term Memory Network with Time Series Data Analysis Capabilities
title_short A Novel Long- and Short-Term Memory Network with Time Series Data Analysis Capabilities
title_full A Novel Long- and Short-Term Memory Network with Time Series Data Analysis Capabilities
title_fullStr A Novel Long- and Short-Term Memory Network with Time Series Data Analysis Capabilities
title_full_unstemmed A Novel Long- and Short-Term Memory Network with Time Series Data Analysis Capabilities
title_sort novel long- and short-term memory network with time series data analysis capabilities
publisher Hindawi Limited
series Mathematical Problems in Engineering
issn 1024-123X
1563-5147
publishDate 2020-01-01
description Time series data are an extremely important type of data in the real world. Time series data gradually accumulate over time. Due to the dynamic growth in time series data, they tend to have higher dimensions and large data scales. When performing cluster analysis on this type of data, there are shortcomings in using traditional feature extraction methods for processing. To improve the clustering performance on time series data, this study uses a recurrent neural network (RNN) to train the input data. First, an RNN called the long short-term memory (LSTM) network is used to extract the features of time series data. Second, pooling technology is used to reduce the dimensionality of the output features in the last layer of the LSTM network. Due to the long time series, the hidden layer in the LSTM network cannot remember the information at all times. As a result, it is difficult to obtain a compressed representation of the global information in the last layer. Therefore, it is necessary to combine the information from the previous hidden unit to supplement all of the data. By stacking all the hidden unit information and performing a pooling operation, a dimensionality reduction effect of the hidden unit information is achieved. In this way, the memory loss caused by an excessively long sequence is compensated. Finally, considering that many time series data are unbalanced data, the unbalanced K-means (UK-means) algorithm is used to cluster the features after dimensionality reduction. The experiments were conducted on multiple publicly available time series datasets. The experimental results show that LSTM-based feature extraction combined with the dimensionality reduction processing of the pooling technology and cluster processing for imbalanced data used in this study has a good effect on the processing of time series data.
url http://dx.doi.org/10.1155/2020/8885625
work_keys_str_mv AT muqiao anovellongandshorttermmemorynetworkwithtimeseriesdataanalysiscapabilities
AT zixuancheng anovellongandshorttermmemorynetworkwithtimeseriesdataanalysiscapabilities
AT muqiao novellongandshorttermmemorynetworkwithtimeseriesdataanalysiscapabilities
AT zixuancheng novellongandshorttermmemorynetworkwithtimeseriesdataanalysiscapabilities
_version_ 1715043045531975680