Fuzzy Classification With Restricted Boltzman Machines and Echo-State Networks for Predicting Potential Railway Door System Failures

IEEE Transactions on Reliability

Volumn 64, Issue 3, 2015, Pages 861-868

  Fink, Olga ^a,b   Zio, Enrico ^c,d   Weidmann, Ulrich ^e  

^a ZURICH UNIVERSITY OF APPLIED SCIENCES   (Switzerland)

^b Massachusetts Institute of Technology   (United States)

^c EDF R AND D   (France)

^d POLITECNICO DI MILANO   (Italy)

^e ETH ZURICH   (Switzerland)

Author keywords

Discrete event diagnostic data; Echo state networks; failure prediction; fuzzy sets; railway door system failures; restricted Boltzman machines

Indexed keywords

CLASSIFICATION (OF INFORMATION); FORECASTING; FUZZY SETS; FUZZY SYSTEMS; RAILROAD ROLLING STOCK; RAILROADS; SYSTEMS ENGINEERING;

DISCRETE EVENTS; DOOR SYSTEM; ECHO STATE NETWORKS; FAILURE PREDICTION; FUZZY CLASSIFICATION; PREDICTION ACCURACY; RAILWAY ROLLING STOCK; RESTRICTED BOLTZMANN MACHINE;

TRANSPORTATION;

EID: 85027924373     PISSN: 00189529     EISSN: None     Source Type: Journal    
DOI: 10.1109/TR.2015.2424213     Document Type: Article

References (39)

1. O. Fink, A. Nash, and U. Weidmann, "Predicting potential railway operational disruptions with Echo state networks," Transport. Res. Record: J. Transport. Res. Board, vol. 2374, no. 1, pp. 66-72, 2013.
2. S. S. Haykin, Neural Networks and Learning Machines, 3rd ed. Upper Saddle River, NJ, USA: Pearson Education, 2009.
3. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2007, corrected printing.
4. A. K. S. Jardine, D. Lin, and D. Banjevic, "A review on machinery diagnostics and prognostics implementing condition-based maintenance," Mech. Syst. Signal Process., vol. 20, no. 7, pp. 1483-1510, 2006.
5. C. Cortes and V. Vapnik, "Support-Vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
6. V. Sugumaran, V. Muralidharan, and K. Ramachandran, "Feature selection using decision tree and classification through proximal support vector machine for fault diagnostics of roller bearing," Mech. Syst. Signal Process., vol. 21, no. 2, pp. 930-942, 2007.
7. S. O. Ogaji and R. Singh, "Advanced engine diagnostics using artificial neural networks," Appl. Soft Comput., vol. 3, no. 3, pp. 259-271, 2003.
8. Z. Tian, L. Wong, and N. Safaei, "A neural network approach for remaining useful life prediction utilizing both failure and suspension histories," Mech. Syst. Signal Process., vol. 24, no. 5, pp. 1542-1555, 2010.
9. W. L. Tan, N. M. Nor, M. Z. A. Bakar, Z. Ahmad, and S. A. Sata, "Optimum parameters for fault detection and diagnosis system of batch reaction using multiple neural networks," J. Loss Prevent. Process Ind., vol. 25, no. 1, pp. 138-141, 2012.
10. Z. N. S. Vanini, K. Khorasani, and N. Meskin, "Fault detection and isolation of a dual spool gas turbine engine using dynamic neural networks and multiple model approach," Inf. Sci., no. 0, 2013.
11. Q. Wu and R. Law, "Complex system fault diagnosis based on a fuzzy robust wavelet support vector classifier and an adaptive Gaussian particle swarm optimization," Inf. Sci., vol. 180, no. 23, pp. 4514-4528, 2010.
12. N. Sakthivel, B. B. Nair, and V. Sugumaran, "Soft computing approach to fault diagnosis of centrifugal pump," Appl. Soft Comput., vol. 12, no. 5, pp. 1574-1581, 2012.
13. A. Azadeh, M. Saberi, A. Kazem, V. Ebrahimipour, A. Nourmohammadzadeh, and Z. Saberi, "A flexible algorithm for fault diagnosis in a centrifugal pump with corrupted data and noise based on {ANN} and support Vector machine with hyper-parameters optimization," Appl. Soft Comput., vol. 13, no. 3, pp. 1478-1485, 2013.
14. M. Seera, C. P. Lim, D. Ishak, and H. Singh, "Offline and online fault detection and diagnosis of induction motors using a hybrid soft computing model," Appl. Soft Comput., vol. 13, no. 12, pp. 4493-4507, 2013.
15. H. D. Ardakani, C. Lucas, D. Siegel, C. Shuo, P. Dersin, B. Bonnet, and J. Lee, "PHM for railway system; A case study on the health assessment of the pointmachines," in Proc. 2012 IEEE Conf. Prognostics and Health Management (PHM), 2012, pp. 1-5.
16. F. B. Zhou, M. D. Duta, M. P. Henry, S. Baker, and C. Burton, "Remote condition monitoring for railway pointmachine," in Proc. 2002 ASME/IEEE Joint Railroad Conf., 2002, pp. 103-108.
17. F. P. G. Marquez, P. Weston, and C. Roberts, "Failure analysis and diagnostics for railway trackside equipment," Eng. Failure Anal., vol. 14, no. 8, pp. 1411-1426, 2007.
18. J. Chen, C. Roberts, and P. Weston, "Fault detection and diagnosis for railway track circuits using neuro-fuzzy systems," Control Eng. Practice, vol. 16, no. 5, pp. 585-596, 2008.
19. A. E. Smith, D. W. Coit, and L. Yun-Chia, "Neural network models to anticipate failures of airport ground transportation vehicle doors," IEEE Trans. Autom. Sci. Eng., vol. 7, no. 1, pp. 183-188, 2010.
20. N. Lehrasab, H. P. B. Dassanayake, C. Roberts, S. Fararooy, and C. J. Goodman, "Industrial fault diagnosis: Pneumatic train door case study," Proc. Inst. Mech. Eng., Part F: J. Rail and Rapid Transit, vol. 216, no. 3, pp. 175-183, 2002.
21. O. Fink, E. Zio, and U. Weidmann, "Predicting time series of railway speed restrictions with time-dependent machine learning techniques," Expert Syst. Applicat., vol. 40, no. 15, pp. 6033-6040, 2013.
22. O. Fink, E. Zio, and U. Weidmann, "Extreme learning machines for predicting operation disruption events in railway systems," in Proc. Eur. Safety and Reliability Conf. (ESREL), Amsterdam, The Netherlands, Sep. 2013.
23. O. Fink, E. Zio, and U. Weidmann, "Predicting Component reliability and level of degradation with complex-valued neural networks," Rel. Eng. Syst. Safety, vol. 121, no. 0, pp. 198-206, 2014.
24. L. A. Zadeh, "Outline of a new approach to the analysis of complex systems and decision processes," IEEE Trans. Syst., Man, Cybern., vol. SMC-3, no. 1, pp. 28-44, 1973.
25. D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, "A learning algorithmfor Boltzmannmachines," Cognit. Sci., vol. 9, no. 1, pp. 147-169, 1985.
26. G. Hinton, "A practical guide to training restricted Boltzmann machines," Momentum, vol. 9, no. 1, 2010.
27. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Computat., vol. 14, no. 8, pp. 1771-1800, 2002.
28. R. Salakhutdinov, A. Mnih, and G. Hinton, "Restricted Boltzmann machines for collaborative filtering," in Proc. Int. Conf. Machine Learning, 2007.
29. G. W. Taylor and G. E. Hinton, "Factored conditional restricted Boltzmann machines for modeling motion style," in Proc. 26th Annu. Int. Conf. Machine Learning (ICML '09), 2009, pp. 1025-1032.
30. H. Jaeger and H. Haas, "Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication," Science, vol. 304, no. 5667, pp. 78-80, 2004.
31. H. Jaeger, "Tutorial on Training Recurrent Neural Networks, Covering BPTT, RTRL, EKF and the "Echo State Network" Approach," Tech. Rep., German National Research Center for Information Technology, 2005.
32. H. Jaeger, M. Lukosevicius, D. Popovici, and U. Siewert, "Optimization and applications of Echo state networks with leaky-integrator neurons," Neural Netw., vol. 20, no. 3, pp. 335-352, 2007.
33. D. Verstraeten, "Reservoir computing: Computation with dynamical systems," Ph.D. dissertation, Ghent University, Ghent, Belgium, 2009.
34. M. Lukosevicius, A Practical Guide to Applying Echo State Networks. Berlin, Germany: Springer, 2012, vol. 7700, Lecture Notes in Computer Science, ch. 36, pp. 659-686.
35. O. Fink, "Failure and degradation prediction by artificial neural networks: Applications to railway systems," Ph.D. dissertation, ETH Zurich, Zurich, Switzerland, 2014.
36. O. Fink, E. Zio, and U. Weidmann, "Anticipating railway operation disruption events based on the analysis of discrete-event diagnostic data," Chem. Eng., vol. 33, 2013.
37. A. E. Hoerl and R. W. Kennard, "Ridge regression: Biased estimation for nonorthogonal problems," Technometrics, vol. 12, no. 1, pp. 55-67, 1970.
38. Y. Bengio, "Gradient-based optimization of hyperparameters," Neural Computat., vol. 12, no. 8, pp. 1889-1900, 2000.
39. N. Japkowicz and M. Shah, Evaluating Learning Algorithms a Classification Perspective. Cambridge, U.K.: Cambridge Univ. Press, 2011.