AIChE Journal, Vol.61, No.2, 419-433, 2015
An Improved Methodology for Outlier Detection in Dynamic Datasets
A time series Kalman filter (TSKF) is proposed that successfully handles outlier detection in dynamic systems, where normal process changes often mask the existence of outliers. The TSKF method combines a time series model fitting procedure with a modified Kalman filter to deal with additive outlier and innovational outlier detection problems in dynamic process dataset. Compared with current outlier detection methods, the new method enjoys the following advantages: (a) no prior knowledge of the process model is needed; (b) it is easy to tune; (c) it can be applied to both univariate and multivariate outlier detection; (d) it is applicable to both on-line and off-line operation; (e) it cleans outliers while maintains the integrity of the original dataset. (c) 2014 American Institute of Chemical Engineers AIChE J, 61: 419-433, 2015
Keywords:outlier detection;Kalman filter;time series modeling;additive outlier;innovational outlier;dynamic process modeling