Anomaly detection of process unit based on LSTM time series reconstruction

DOU Shan; ZHANG Guangyu; XIONG Zhihua

doi:10.11949/j.issn.0438-1157.20181050

您当前的位置：

首页 >

文章列表页 >

Anomaly detection of process unit based on LSTM time series reconstruction

Process system engineering | 更新时间：2026-07-24

- Anomaly detection of process unit based on LSTM time series reconstruction
- CIESC Journal Vol. 70, Issue 2, Pages: 481-486(2019)
- 作者机构：
  
  1.清华大学自动化系，北京100084
  2.浙江航天恒嘉数据科技有限公司，浙江嘉兴 314201
- 作者简介：
- 基金信息：
- DOI：10.11949/j.issn.0438-1157.20181050
  CLC： TP 391
- Received：19 September 2018，
  
  Revised：2018-10-18，
  
  Online First：16 June 2020，
  
  Published：05 February 2019
- 稿件说明：
移动端阅览
窦珊, 张广宇, 熊智华. 基于LSTM时间序列重建的生产装置异常检测[J]. 化工学报, 2019, 70(2): 481-486

DOU Shan, ZHANG Guangyu, XIONG Zhihua. Anomaly detection of process unit based on LSTM time series reconstruction[J]. CIESC Journal, 2019, 70(2): 481-486
窦珊, 张广宇, 熊智华. 基于LSTM时间序列重建的生产装置异常检测[J]. 化工学报, 2019, 70(2): 481-486 DOI： 10.11949/j.issn.0438-1157.20181050.

DOU Shan, ZHANG Guangyu, XIONG Zhihua. Anomaly detection of process unit based on LSTM time series reconstruction[J]. CIESC Journal, 2019, 70(2): 481-486 DOI： 10.11949/j.issn.0438-1157.20181050.

摘要

工业生产装置通常设置传感器报警阈值进行报警，但是对处于报警阈值以下的时间序列异常难以及时捕捉。基于统计的传统检测方法在解决时间序列异常检测上存在很大挑战，因此提出基于long short term memory (LSTM)时间序列重建的方法进行生产装置的异常检测。该算法首先引入一层LSTM网络对传感器数据的时间序列进行向量表示，采用另一层LSTM网络对时间序列进行逆序重建，然后利用重建值与实际值之间的误差，通过极大似然估计方法对该段序列进行异常概率估计，最终通过学习异常报警阈值实现时间序列异常检测。采用ECG测试数据、能源数据与危险品储罐传感器数据进行了仿真实验，验证了所提方法在不同长度的数据上的有效性。

Abstract

Industrial production equipment usually sets sensor alarm thresholds for alarms

but it is difficult to capture time series abnormalities below the alarm thresholds. The traditional statistics based detection method has great challenges in these time series anomaly detection. In this paper

an approach to the anomaly detection of process units is proposed by using the long short term memory (LSTM) time series reconstruction. At first

an LSTM network is introduced to vectorize the time series of sensor data

and another LSTM network is utilized to reconstruct the time series in reverse sequence. Then

the errors between the reconstructed values and the actual values are used to estimate the anomaly probability by the maximum likelihood estimation method. Eventually

anormaly detection is achieved by learning the abnormal alarm thresholds. Simulation resutls on the ECG standard testing data

energy data and sensor data of the dangerous goods tank have shown the effectiveness of the proposed method on data with different lengths.

关键词

Keywords

references

周大镯 , 刘月芬 , 马文秀 . 时间序列异常检测 [J ] . 计算机工程与应用 , 2008 , 44 ( 35 ): 145 - 147 .

Zhou D Z , Liu Y F , Ma W X . Effective time series outlier detection algorithm based on segmentation [J ] . Computer Engineering and Applications , 2008 , 44 ( 35 ): 145 - 147 .

Hawkins D M . Identification of Outliers [M ] . London : Chapman and Hall , 1980 : 25 .

Billor N , Hadi A S , Velleman P F . BACON: blocked adaptive computationally efficient outlier nominators [J ] . Computational Statistics & Data Analysis , 2000 , 34 ( 3 ): 279 - 298 .

Knorr E M , Ng R T . A unified notion of outliers: properties and computation [C ] // KDD . 1997 : 219 - 222 .

李钢 , 周东华 . 基于SPM的多变量连续过程在线故障预测方法 [J ] . 化工学报 , 2008 , 59 ( 7 ): 1829 - 1833 .

Li G , Zhou D H . SPM-based online fault prediction approach for multivariate continuous processes [J ] . Journal of Chemical Industry and Engineering(China) , 2008 , 59 ( 7 ): 1829 - 1833 .

张浩 , 刘振娟 , 李宏光 , 等 . 基于关联变量时滞分析卷积神经网络的生产过程时间序列预测方法 [J ] . 化工学报 , 2017 , 68 ( 9 ): 3501 - 3510 .

Zhang H , Liu Z J , Li H G , et al . Process time series prediction based on application of correlated process variables to CNN time delayed analyses [J ] . CIESC Journal , 2017 , 68 ( 9 ): 3501 - 3510 .

Page E S . Continuous inspection schemes [J ] . Biometrika , 1954 , 41 ( 1/2 ): 100 - 115 .

Basseville M , Nikiforov I V . Detection of Abrupt Changes: Theory and Application [M ] . Englewood Cliffs : Prentice Hall , 1993 : 30 .

Ma J , Perkins S . Time-series novelty detection using one-class support vector machines [C ] //Neural Networks, 2003 . Proceedings of the International Joint Conference on. IEEE , 2003 : 1741 - 1745 .

王少军 . 时间序列预测的可重构计算研究 [D ] . 哈尔滨 : 哈尔滨工业大学 , 2012 : 35 .

Wang S J . Research on reconfigurable computing for time series forecasting [D ] . Harbin : Harbin Institute of Technology , 2012 : 35 .

Hochreiter S , Schmidhuber J . Long short-term memory [J ] . Neural Computation , 1997 , 9 ( 8 ): 1735 - 1780 .

Sutskever I , Vinyals O , Le Q V . Sequence to sequence learning with neural networks [C ] // Advances in Neural Information Processing Systems , 2014 : 3104 - 3112 .

Miwa M , Bansal M . End-to-end relation extraction using LSTMs on sequences and tree structures [C ] // Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2016 : 1105 - 1116 .

Choi Y , Breck E , Cardie C . Joint extraction of entities and relations for opinion recognition [C ] // Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics , 2006 : 431 - 439 .

Graves A , Schmidhuber J . Offline handwriting recognition with multidimensional recurrent neural networks [C ] // Advances in Neural Information Processing Systems , 2009 : 545 - 552 .

Messina R , Louradour J . Segmentation-free handwritten Chinese text recognition with LSTM-RNN [C ] //Document Analysis and Recognition (ICDAR), 2015 13th International Conference on . IEEE , 2015 : 171 - 175 .

Huang Z , Xu W , Yu K . Bidirectional LSTM-CRF models for sequence tagging [J ] . arXivpreprint arXiv: 1508 . 01991 , 2015 .

Ma X , Hovy E . End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF [C ] // Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2016 : 1064 - 1074 .

Cho K , van Merrienboer B , Bahdanau D , et al . On the properties of neural machine translation: encoder–decoder approaches [C ] // Proceedings of SSST-8 , Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation , 2014 : 103 - 111 .

Cho K , Van M B , Gulcehre C , et al . Learning phrase representations using RNN encoder–decoder for statistical machine translation [C ] // Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) , 2014 : 1724 - 1734 .

Cybenko G . Approximation by superpositions of a sigmoidal function [J ] . Mathematics of Control , Signals and Systems , 1989 , 2 ( 4 ): 303 - 314 .

Maas A L , Hannun A Y , Ng A Y . Rectifier nonlinearities improve neural network acoustic models [J ] . Proc. Icml. , 2013 , 30 ( 1 ): 3 .

Graves A . Long short-term memory [M ] // Supervised Sequence Labelling with Recurrent Neural Networks . Heidelberg, Berlin : Springer , 2012 : 37 - 45 .

Chung J , Gulcehre C , Cho K H , et al . Empirical evaluation of gated recurrent neural networks on sequence modeling [J ] . arXivpreprint arXiv: 1412 . 3555 , 2014 .

Bock R D , Aitkin M . Marginal maximum likelihood estimation of item parameters: application of an EM algorithm [J ] . Psychometrika , 1981 , 46 ( 4 ): 443 - 459 .

Malhotra P , Vig L , Shroff G , et al . Long short term memory networks for anomaly detection in time series [C ] // 23rd European Symposium on Artificial Neural Networks , Computational Intelligence and Machine Learning, ESANN 2015 .

Bruges , Belgium , 2015 : 89 .

Goutte C , Gaussier E . A probabilistic interpretation of precision , recall and F-score , with implication for evaluation [C ] // European Conference on Information Retrieval . Heidelberg, Berlin : Springer , 2005 : 345 - 359 .

Le Q V , Ngiam J , Coates A , et al . On optimization methods for deep learning [C ] // Proceedings of the 28th International Conference on International Conference on Machine Learning . Omnipress , 2011 : 265 - 272 .

Kingma D P , Ba J . Adam: a method for stochastic optimization [J ] . arXivpreprint arXiv: 1412 . 6980 , 2014 .

Connor J T , Martin R D , Atlas L E . Recurrent neural networks and robust time series prediction [J ] . IEEE Transactions on Neural Networks , 1994 , 5 ( 2 ): 240 - 254 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Intermittent process fault monitoring based on recurrent autoencoder

Chemical process data imputation method based on DAT-MIGAN model

Leak localization method for gas pipeline based on TPE-XGBoost modeling

Contrastive learning based on method for identifying operating conditions of ethylene cracking furnace

Prediction of scale factor of heat exchangers based on CNN-LSTM neural network

Related Author

GAO Xuejin

LIU Tengfei

XU Zidong

GAO Huihui

YU Yongchuan

GENG Zhiqiang

LI Jiajun

WEI Wei

Related Institution

Faculty of Information Technology, Beijing University of Technology

Engineering Research Center of Digital Community, Ministry of Education

Beijing Laboratory for Urban Mass Transit

Beijing Key Laboratory of Computational Intelligence and Intelligent System

College of Information Science and Technology, Beijing University of Chemical Technology

⁰