Estimation of complete discrete multivariate probability distributions from scarce data with application to risk assessment and fault detection

Industrial and Engineering Chemistry Research

Volumn 53, Issue 18, 2014, Pages 7538-7547

  Ahooyi, Taha Mohseni ^a   Arbogast, Jeffrey E ^b   Oktem, Ulku G ^d   Seider, Warren D ^c   Soroush, Masoud ^a  

^a Drexel University   (United States)

^b AIR LIQUIDE   (France)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

^d UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; FAULT DETECTION; OPTIMIZATION; PROBABILITY DISTRIBUTIONS; RISK ASSESSMENT;

EQUALITY CONSTRAINTS; FAULT PROPAGATION; FIRST-PRINCIPLES MODEL; INFORMATION ENTROPY; INTERACTIVE SYSTEM; MULTIVARIATE PROBABILITY DISTRIBUTIONS; NON-MONOTONIC RELATIONS; OPTIMAL SELECTION;

ESTIMATION;

EID: 84900400370     PISSN: 08885885     EISSN: 15205045     Source Type: Journal    
DOI: 10.1021/ie404232v     Document Type: Article

References (37)

1. Harms-Ringdahl, L. Safety Analysis, Principles and Practice in Occupational Safety; CRC Press: New York, 2001.
2. Garvey, P. R. Analytical Methods for Risk Management: A Systems Engineering Perspective; Chapman and Hall/CRC: Boca Raton, FL, 2009.
3. Taleb, N. N. The Black Swan: The Impact of the Highly Improbable; Random House: New York, 2007.
4. Kaynar, B.; Ridder, A. The cross-entropy method with patching for rare-event simulation of large Markov chains Eur. J. Oper. Res. 2010, 207, 1380-1397
5. Shahabuddin, P. Rare event simulation of stochastic systems. In Proceedings of the 1995 Winter Simulation Conference. IEEE Press: Washington, DC, 1995; pp 178-185.
6. Cerou, F.; LeGland, F.; Del Moral, P.; Lezaud, P. Limit theorems for the multilevel splitting algorithm in the simulation of rare events. In Proceedings of the 2005 Winter Simulation Conference, Orlando, FL, 2005; pp 682-691.
7. Scott, D. W. Multivariate Density Estimation: Theory, Practice, and Visualization; John Wiley: New York, 1992.
8. Tsybakov, A. B. Introduction to Nonparametric Estimation; Springer: New York, 2009.
9. Devroye, L.; Gábor, L. Combinatorial Methods in Density Estimation; Springer: New York, 2001.
10. Piotr, J.; Durante, F.; Härdle, W. K.; Rychlik, T. Copula Theory and Its Applications: Proceedings of the Workshop Held in Warsaw 2009; Springer: Heidelberg, 2010.
11. Zellner, A.; Highfield, A. R. Calculation of maximum entropy distribution and approximation of marginal posterior distributions J. Econometrics 1988, 37, 195-209
12. Duong, T.; Hazelton, M. L. Convergence rates for unconstrained bandwidth matrix selectors in multivariate kernel density estimation J. Multivar. Anal. 2005, 93, 417-433
13. Embrechts, P.; Lindskog, F.; McNeil, A. Modelling dependence with copulas and applications to risk management. In Handbook of Heavy Tailed Distributions in Finance Rachev, S., Ed.; Elsevier: New York, 2003; pp 331-385.
14. Mehranbod, N.; Soroush, M.; Panjapornpon, C. A method of sensor fault detection and identification J. Process Control 2005, 15, 321-339
15. Villez, K.; Srinivasan, B.; Rengaswamy, R.; Narasimhan, S.; Venkatasubramanian, V. Kalman-based strategies for Fault Detection and Identification (FDI): Extensions and critical evaluation for a buffer tank system Comput. Chem. Eng. 2011, 35 (5) 806-816
16. Bin Shams, M. A.; Budman, H. M.; Duever, T. A. Fault detection, identification and diagnosis using CUSUM based PCA Chem. Eng. Sci. 2011, 66 (20) 4488-4498
17. Pariyani, A.; Seider, W. D.; Oktem, U. G.; Soroush, M. Improving process safety and product quality using large databases. In Computer-Aided Chemical Engineering; Pierucci, S.; Buzzi Ferraris, G., Eds.; Elsevier: Naples, Italy, 2010; Vol. 28, pp 175-180.
18. Castillo, I.; Edgar, T. F.; Dunia, R. Nonlinear model-based fault detection with fuzzy set fault isolation. In IECON 2010-36th Annual Conference on IEEE Industrial Electronics Society, Phoenix, AZ, 2010; pp 174-179.
19. Özyurt, B.; Kandel, A. A hybrid hierarchical neural network-fuzzy expert system approach to chemical process fault diagnosis Fuzzy Sets Syst. 1996, 83 (1) 11-25
20. Isermann, R. Fault-Diagnosis Systems: An Introduction from Fault Detection to Fault Tolerance; Springer: Berlin, 2006.
21. Mohseni Ahooyi, T.; Arbogast, J. E.; Oktem, U.; Seider, W. D.; Soroush, M. Maximum-Likelihood Maximum-Entropy Estimation of Multivariate Probability Density Functions AIChE J. 2014, 60 (3) 1013-1026
22. Hastie, T.; Tibshirani, R.; Friedman, J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction; Springer: New York, 2003.
23. Shannon, C. E. A mathematical theory of communication Bell Syst. Tech. J. 1984, 27, 379-423
24. Williams, D. Weighing the Odds: A Course in Probability and Statistics; Cambridge University Press: New York, 2001.
25. Shannon, C. E. Prediction and entropy of printed English Bell Syst. Tech. J. 1951, 30, 50-64
26. Gray, R. M. Entropy and Information Theory, 2 nd ed.; Springer: New York, 2011.
27. Eliason, S. R. Maximum Likelihood Estimation: Logic and Practice; SAGE Publications, Inc.: Newbury Park, CA, 1993.
28. Ruszczyński, A. Nonlinear Optimization; Princeton University Press: Princeton, NJ, 2006.
29. Subramanian, J.; Simon, R. Overfitting in prediction models-Is it a problem only in high dimensions? Contemp. Clin. Trials 2013, 36 (2) 636-641
30. Jefferys, W. H.; Berger, J. O. Ockham's Razor and Bayesian Statistics Am. Sci. 1991, 80, 64-72
31. Briscoe, E.; Feldman, J. Conceptual complexity and the bias/variance tradeoff Cognition 2011, 118 (1) 2-16
32. Ando, T. Bayesian Model Selection and Statistical Modeling; Chapman and Hall/CRC: Boca Raton, FL, 2010.
33. Ferentinos, K. On Tchebycheff's type inequalities Trab. Estadística Invest. Oper. 1982, 33 (1) 125-132
34. Netica v. 4.16 [software]; Norsys Software Corporation; Vancouver, BC, Canada, 2010. Available at http://www.norsys.com.
35. Quenouille, M. H. Notes on Bias in Estimation Biometrika 1956, 43 (3-4) 353-360
36. Lauritzen, L.; Spiegelhalter, J. Local computations with probabilities on graphical structures and their application to expert systems J. R. Stat. Soc. 1988, 50, 157-224
37. Kullback, S. Letter to the Editor: The Kullback-Leibler distance Am. Stat. 1987, 41, 340-341