Development and application of deep belief networks for predicting railway operation disruptions

International Journal of Performability Engineering

Volumn 11, Issue 2, 2015, Pages 121-134

  Fink, Olga ^a,b   Zio, Enrico ^c,d   Weidmann, Ulrich ^e  

^a ZURICH UNIVERSITY OF APPLIED SCIENCES   (Switzerland)

^b Massachusetts Institute of Technology   (United States)

^c EDF R AND D   (France)

^d POLITECNICO DI MILANO   (Italy)

^e ETH ZURICH   (Switzerland)

Author keywords

Deep belief networks; Discrete event diagnostic data; Door system; Multilayer perceptron; Railway operations disruptions

Indexed keywords

BENCHMARKING; FLEET OPERATIONS; GENETIC ALGORITHMS; RAILROAD TRANSPORTATION; RAILS;

CASE-STUDIES; DEEP BELIEF NETWORKS; DEVELOPMENT AND APPLICATIONS; DISCRETE EVENTS; DISCRETE-EVENT DIAGNOSTIC DATA; DOOR SYSTEM; MULTILAYERS PERCEPTRONS; RAIL VEHICLES; RAILWAY OPERATION DISRUPTION; RAILWAY OPERATIONS;

RAILROADS;

EID: 84930251679     PISSN: 09731318     EISSN: 29938341     Source Type: Journal    
DOI: None     Document Type: Article

References (24)

1. Jardine, A.K.S., D. Lin, and D. Banjevic. A Review on Machinery Diagnostics and Prognostics Implementing Condition-based Maintenance. Mechanical Systems and Signal Processing. 2006; 20(7): 1483-1510.
2. Smith, A. E., D.W. Coit, and L. Yun-Chia. Neural Network Models to Anticipate Failures of Airport Ground Transportation Vehicle Doors. Automation Science and Engineering, IEEE Transactions on. 2010; 7(1):183-188.
3. Dahl, G. E., D. Yu, L. Deng, and A. Acero. Context-dependent Pre-trained Deep Neural Networks for Large Vocabulary Speech Recognition. IEEE Transactions on Audio, Speech, and Language Processing, 2012; 20(1):30-42.
4. Hinton, G. E., and R. R. Salakhutdinov. Reducing the Dimensionality of Data with Neural Networks. Science. 2006; 313(5786):504-507.
5. Ciresan, D., U. Meier, and J. Schmidhuber. Multi-Column Deep Neural Networks for Image Classification. In: Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE; 2012. p. 3642-3649.
6. Lee, H., R. Grosse, R. Ranganath, and A. Y. Ng. Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations. In: Proceedings of the 26th Annual International Conference on Machine Learning. ACM; 2009. p. 609-616.
7. Tamilselvan, P., and P. Wang. Failure Diagnosis using Deep Belief Learning based Health State Classification. Reliability Engineering and System Safety, July 2013; 115:124-135.
8. Tran, V.T., F. AlThobiani, and A. Ball. An Approach to Fault Diagnosis of Reciprocating Compressor Valves using Teager Kaiser Energy Operator and Deep Belief Networks. Expert Systems with Applications. 2014; 41(9):4113-4122. Available from: http://www. sciencedirect.com/science/article/pii/S0957417413010014.
9. Hinton, G. E., S. Osindero, and Y. W. Teh. A Fast Learning Algorithm for Deep Belief Nets. Neural Computation. 2006; 18(7):1527-1554.
10. Larochelle, H., and Y. Bengio. Classification using Discriminative Restricted Boltzmann Machines. In: Proceedings of the 25th international conference on Machine learning. ACM; 2008. p. 536-543.
11. Ackley, D. H., G. E. Hinton, and T. J. Sejnowski. A Learning Algorithm for Boltzmann Machines. Cognitive Science. 1985; 9(1):147-169.
12. Taylor, G.W., and G. E. Hinton. Factored Conditional Restricted Boltzmann Machines for Modeling Motion Style. Proc. 26th International Conference on Machine Learning, June 2009, pp 1025-1032. Omnipress, Montreal, Quebec.
13. Salakhutdinov, R., A. Mnih, and G. Hinton. Restricted Boltzmann Machines for Collaborative Filtering. In: Proceedings of the 24th International Conference on Machine Learning, 2007, 791-798.
14. Zeiler, M. D., G.W. Taylor, N. F. Troje, and G. E. Hinton. Modeling Pigeon Behaviour using a Conditional Restricted Boltzmann Machine. In: 17th European Symposium on Artificial Neural Networks (ESANN); 2009.
15. Fink, O., E. Zio, and U. Weidmann. Predicting Time Series of Railway Speed Restrictions with Time-dependent Machine Learning Techniques. Expert Systems with Applications.2013; 40(15):6033-6040. Available from: http://www.sciencedirect.com/science /article/pii/S0957417413002868.
16. Fink, O. Failure and Degradation Prediction by Artificial Neural Networks: Applications to Railway Systems. ETH Zurich; 2014.
17. Fink, O., A. Nash, and U. Weidmann. Predicting Potential Railway Operational Disruptions with Echo State Networks. Transportation Research Record. Journal of the Transportation Research Board. 2013; 2374(1):66-72.
18. Duda, R.O., P. E. Hart, and D. G. Stork. Pattern Classification. 2nd ed. New York: John Wiley; 2001.
19. Rubinstein, R. Y., and D. P. Kroese. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning. Springer; 2004.
20. Kline, D., and V. Berardi. Revisiting Squared-Error and Cross-Entropy Functions for Training Neural Network Classifiers. Neural Computing and Applications. 2005; 14(4):310-318.
21. Hornik, K., M. Stinchcombe, and H. White. Multilayer Feed-Forward Networks are Universal Approximators. Neural Networks. 1989; 2(5):359-366.
22. Goldberg, D. E. Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley Publishing Co. Inc., Reading, Massachusetts , 1989.
23. Kohavi, R. A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. In: International Joint Conference on Artificial Intelligence (IJCAI). Morgan Kaufmann; 1995. p. 1137-1145.
24. Japkowicz, N., and Mohak Shah. Evaluating Learning Algorithms: A Classification Perspective. Cambridge University Press; Cambridge, 2011.