System identification in presence of outliers

IEEE Transactions on Cybernetics

Volumn 46, Issue 5, 2016, Pages 1202-1216

  Yu, Chao ^a   Wang, Qing Guo ^a   Zhang, Dan ^b   Wang, Lei ^a   Huang, Jiangshuai ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b ZHEJIANG UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Denoising; interior point methods; low rank matrix; matrix decomposition; outlier detection; semidefinite programming (SDP); sparsity; system identification

Indexed keywords

DATA HANDLING; MATRIX ALGEBRA; OPTIMIZATION; STATISTICS;

COMPUTATIONAL BURDEN; COMPUTATIONAL COSTS; FILTERING METHOD; INTERIOR POINT METHODS; LOW-RANK PROPERTIES; MATRIX DECOMPOSITION; OUTLIER DETECTION; SEMIDEFINITE PROGRAMMING PROBLEM;

PROBLEM SOLVING;

EID: 84929773331     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2015.2430356     Document Type: Article

References (71)

1. R. K. Pearson, "Outliers in process modeling and identification," IEEE Trans. Control Syst. Technol., vol. 10, no. 1, pp. 55-63, Jan. 2002.
2. V. J. Hodge and J. Austin, "A survey of outlier detection methodologies," Artif. Intell. Rev., vol. 22, no. 2, pp. 85-126, 2004.
3. D. Zhang, L. Yu, and Q.-G. Wang, "Fault detection for a class of network-based nonlinear systems with communication constraints and random packet dropouts," Int. J. Adapt. Control Signal Process., vol. 25, no. 10, pp. 876-898, 2011.
4. W. Liu, Z. Wang, and M. Ni, "Controlled synchronization for chaotic systems via limited information with data packet dropout," Automatica, vol. 49, no. 8, pp. 2576-2579, 2013.
5. H. Dong, Z. Wang, J. Lam, and H. Gao, "Fuzzy-model-based robust fault detection with stochastic mixed time delays and successive packet dropouts," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 365-376, Apr. 2012.
6. M. Davy and S. Godsill, "Detection of abrupt spectral changes using support vector machines an application to audio signal segmentation," in Proc. Int. Conf. Acoust. Speech Signal Process. (ICASSP), vol. 2. Orlando, FL, USA, 2002, pp. II-1313-II-1316.
7. G. G. Hazel, "Multivariate Gaussian MRF for multispectral scene segmentation and anomaly detection," IEEE Trans. Geosci. Remote Sens., vol. 38, no. 3, pp. 1199-1211, May 2000.
8. M. J. Desforges, P. J. Jacob, and J. E. Cooper, "Applications of probability density estimation to the detection of abnormal conditions in engineering," Proc. Inst. Mech. Eng. C, J. Mech. Eng. Sci., vol. 212, no. 8, pp. 687-703, 1998.
9. R. J. Bolton and D. J. Hand, "Unsupervised profiling methods for fraud detection," in Proc. Credit Scor. Credit Control VII, Edinburgh, U.K., 2001, pp. 235-255.
10. H. He, J. Wang, W. Graco, and S. Hawkins, "Application of neural networks to detection of medical fraud," Expert Syst. Appl., vol. 13, no. 4, pp. 329-336, 1997.
11. W. W.-S. Wei, Time Series Analysis. Redwood City, CA, USA: Addison- Wesley, 1994.
12. F. Pukelsheim, "The three sigma rule," Amer. Statist., vol. 48, no. 2, pp. 88-91, 1994.
13. R. D. Martin and D. J. Thomson, "Robust-resistant spectrum estimation," Proc. IEEE, vol. 70, no. 9, pp. 1097-1115, Sep. 1982.
14. R. K. Pearson, "Exploring process data," J. Process Control, vol. 11, no. 2, pp. 179-194, 2001.
15. H. Liu, S. Shah, and W. Jiang, "On-line outlier detection and data cleaning," Comput. Chem. Eng., vol. 28, no. 9, pp. 1635-1647, 2004.
16. P. J. Rousseeuw, "Least median of squares regression," J. Amer. Statist. Assoc., vol. 79, no. 388, pp. 871-880, 1984.
17. D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu, "On the least trimmed squares estimator," Algorithmica, vol. 69, no. 1, pp. 1-36, 2007.
18. P. Bloomfield and W. L. Steiger, Least Absolute Deviations. Boston, MA, USA: Birkhauser, 1984.
19. P. W. Holland and R. E. Welsch, "Robust regression using iteratively reweighted least-squares," Commun. Statist. Theory Methods, vol. 6, no. 9, pp. 813-827, 1977.
20. S. P. Ellis, "Instability of least squares, least absolute deviation and least median of squares linear regression," Statist. Sci., vol. 13, no. 4, pp. 337-350, 1998.
21. D. Reynolds, "Gaussian mixture models," in Encyclopedia of Biometrics. New York, NY, USA: Springer, 2009, pp. 659-663.
22. S. Roberts and L. Tarassenko, "A probabilistic resource allocating network for novelty detection," Neural Comput., vol. 6, no. 2, pp. 270-284, 1994.
23. C. M. Bishop, "Novelty detection and neural network validation," IEE Proc. Vis. Image Signal Process., vol. 141, no. 4, pp. 217-222, 1994.
24. K. L. Lange, R. J. Little, and J. M. Taylor, "Robust statistical modeling using the t-distribution," J. Amer. Statist. Assoc., vol. 84, no. 408, pp. 881-896, 1989.
25. Y. Lee, H. Hahn, Y. Han, and J. Lee, "Robust speaker identification based on t-distribution mixture model," in AI 2005: Advances in Artificial Intelligence. Berlin, Germany: Springer, 2005, pp. 896-899.
26. A. Leontitsis. (2004). LMS Toolbox. [Online]. Available: http://www.mathworks.com/matlabcentral/fileexchange/801-lms-toolbox
27. J. Agullo, C. Croux, and S. Van Aelst, "The multivariate least-trimmed squares estimator," J. Multivar. Anal., vol. 99, no. 3, pp. 311-338, 2008.
28. M. A. Branch and A. Grace, MATLAB: Optimization Toolbox: Users Guide Version 1.5. Natick, MA, USA: MathWorks, 1996.
29. B. Jones, MATLAB: Statistics Toolbox; Users Guide. Natick, MA, USA: MathWorks, 1997.
30. V. Chandola, A. Banerjee, and V. Kumar, "Anomaly detection: A survey," ACM Comput. Surv. (CSUR), vol. 41, no. 3, p. 15, 2009.
31. R. H. Kwong and D. L. Yonge-Mallo, "Fault diagnosis in discrete-event systems: Incomplete models and learning," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 118-130, Feb. 2011.
32. H. Yang, Y. Xia, and B. Liu, "Fault detection for T-S fuzzy discrete systems in finite-frequency domain," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 4, pp. 911-920, Aug. 2011.
33. E. J. Cands, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis?" J. ACM, vol. 58, no. 3, p. 1-39, 2011.
34. J. Wright, A. Ganesh, S. Rao, Y. G. Peng, and Y. Ma, "Robust principal component analysis: Exact recovery of corrupted low-rank matrices via convex optimization," in Proc. Adv. Neural Inf. Process. Syst., vol. 22. Whistler, BC, Canada, 2009, pp. 2080-2088.
35. X. Lu, T. Gong, P. Yan, Y. Yuan, and X. Li, "Robust alternative minimization for matrix completion," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 3, pp. 939-949, Jun. 2012.
36. R. Basri and D. W. Jacobs, "Lambertian reflectance and linear subspaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 2, pp. 218-233, Feb. 2003.
37. R. Zhi, M. Flierl, Q. Ruan, and W. B. Kleijn, "Graph-preserving sparse nonnegative matrix factorization with application to facial expression recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 38-52, Feb. 2011.
38. S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman, "Indexing by latent semantic analysis," J. Amer. Soc. Inf. Sci., vol. 41, no. 6, pp. 391-407, 1990.
39. Z. Lin, M. Chen, and Y. Ma. The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices. [Online]. Available: http://arxiv.org/abs/1009.5055
40. Z. Lin et al., "Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix," in Proc. Comput. Adv. Multi-Sens. Adapt. Process. (CAMSAP), vol. 61. Aruba, Dutch Antilles, 2009, pp. 1-18.
41. A. Ganesh et al., "Fast algorithms for recovering a corrupted low-rank matrix," in Proc. 3rd IEEE Int. Workshop Comput. Adv. Multi-Sens. Adapt. Process. (CAMSAP), Aruba, Dutch Antilles, 2009, pp. 213-216.
42. M. Ayazoglu, M. Sznaier, and O. I. Camps, "Fast algorithms for structured robust principal component analysis," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Providence, RI, USA, 2012, pp. 1704-1711.
43. M. Fazel, H. Hindi, and S. Boyd, "Rank minimization and applications in system theory," in Proc. Amer. Control Conf., vol. 4. Boston, MA, USA, 2004, pp. 3273-3278.
44. Z. Liu and L. Vandenberghe, "Interior-point method for nuclear norm approximation with application to system identification," SIAM J. Matrix Anal. Appl., vol. 31, no. 3, pp. 1235-1256, 2009.
45. L. Ljung, System Identification: Theory for the User. Upper Saddle River, NJ, USA: Prentice-Hall, 1999.
46. T. Soderstrom and P. Stoica, System Identification. New York, NY, USA: Prentice-Hall, 1988.
47. T. Soderstrom and P. Stoica, Instrumental Variable Methods for System Identification, vol. 161. Berlin, Germany: Springer, 1983.
48. T. Soderstrom, "A generalized instrumental variable estimation method for errors-in-variables identification problems," Automatica, vol. 47, no. 8, pp. 1656-1666, 2011.
49. V. Chandrasekaran, S. Sanghavi, P. A. Parrilo, and A. S. Willsky, "Rank-sparsity incoherence for matrix decomposition," SIAM J. Optim., vol. 21, no. 2, pp. 572-596, 2011.
50. C. Helmberg, F. Rendl, R. J. Vanderbei, and H. Wolkowicz, "An interiorpoint method for semidefinite programming," SIAM J. Optim., vol. 6, no. 2, pp. 342-361, 1996.
51. R. H. Tutuncu, K. C. Toh, and M. J. Todd, "Solving semidefinitequadratic- linear programs using SDPT3," Math. Program., vol. 95, no. 2, pp. 189-217, 2003.
52. L. Vandenberghe and S. Boyd, "Semidefinite programming," SIAM Rev., vol. 38, no. 1, pp. 49-95, 1996.
53. H. Wolkowicz, Semidefinite Programming. Faculty Math., Univ. Waterloo, Waterloo, ON, Canada, 2002.
54. S. P. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
55. J. J. Dattorro, Convex Optimization and Euclidean Distance Geometry. Palo Alto, CA, USA: Meboo, 2005.
56. M. J. Todd, K. C. Toh, and R. H. Tutuncu, "On the Nesterov-Todd direction in semidefinite programming," SIAM J. Optim., vol. 8, no. 3, pp. 769-796, 1998.
57. L. Vandenberghe, V. R. Balakrishnan, R. Wallin, A. Hansson, and T. Roh, "Interior-point algorithms for semidefinite programming problems derived from the KYP lemma," in Positive Polynomials in Control. Berlin, Germany: Springer, 2005, pp. 195-238.
58. Z. Liu, "Structured semidefinite programs in system identification and control," Ph.D. dissertation, Dept. Electr. Eng., Univ. California, Los Angeles, CA, USA, 2009.
59. K. M. Anstreicher and J.-P. Vial, "On the convergence of an infeasible primal-dual interior-point method for convex programming," Optim. Methods Soft., vol. 3, no. 4, pp. 273-283, 1994.
60. Y. Zhang, "On extending some primal-dual interior-point algorithms from linear programming to semidefinite programming," SIAM J. Optim., vol. 8, no. 2, pp. 365-386, 1998.
61. M. Holmes, A. Gray, and C. Isbell, "Fast SVD for large-scale matrices," in Proc. Workshop Efficient Mach. Learn. NIPS, Whistler, BC, Canada, 2007, pp. 1-2.
62. S. Mallat, A Wavelet Tour of Signal Processing. San Diego, CA, USA: Academic Press, 1999.
63. S. D. Ruikar and D. D. Doye, "Wavelet based image denoising technique," Int. J. Adv. Comput. Sci. Appl., vol. 2, no. 3, pp. 49-53, 2011.
64. G. Cristobal, M. Chagoyen, B. Escalante-Ramirez, and J. R. Lopez, "Wavelet-based denoising methods: A comparative study with applications in microscopy," in Proc. SPIEs Int. Symp. Opt. Sci. Eng. Instrum., Denver, CO, USA, 1996, pp. 660-671.
65. A. C. To, J. R. Moore, and S. D. Glaser, "Wavelet denoising techniques with applications to experimental geophysical data," Signal Process., vol. 89, no. 2, pp. 144-160, 2009.
66. M. Misiti, Y. Misiti, G. Oppenheim, and J.-M. Poggi, Wavelets and Their Applications. New York, NY, USA: Wiley, 2007.
67. D. L. Donoho and I. M. Johnstone, "Adapting to unknown smoothness via wavelet shrinkage," J. Amer. Statist. Assoc., vol. 90, no. 432, pp. 1200-1224, 1995.
68. C. M. Stein, "Estimation of the mean of a multivariate normal distribution," Ann. Stat., vol. 9, no. 6, pp. 1135-1151, 1981.
69. J. Dahl and L. Vandenberghe. Cvxopt: A python package for convex optimization. [Online]. Available: http://cvxopt.org/
70. J. Lofberg, "YALMIP: A toolbox for modeling and optimization in MATLAB," in Proc. Int. Symp. Comput. Aided Control Syst. Design, Taipei, Taiwan, 2004, pp. 284-289.
71. ( 2013). Test Program for MATLAB and Python. [Online]. Available: http://stackoverflow.com/questions/17559140/matlab-twice-as-fast-asnumpy