Evaluating machine learning models for engineering problems

Artificial Intelligence in Engineering

Volumn 13, Issue 3, 1999, Pages 257-272

  Reich, Yoram ^a   Barai, S V ^b  

^a TEL AVIV UNIVERSITY   (Israel)

^b INDIAN INSTITUTE OF TECHNOLOGY   (India)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; MATHEMATICAL MODELS; NEURAL NETWORKS; STATISTICAL TESTS;

SYSTEMATIC EVALUATION;

ARTIFICIAL INTELLIGENCE;

EID: 0032628293     PISSN: 09541810     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0954-1810(98)00021-1     Document Type: Article

References (36)

1. Reich Y. Machine learning techniques for civil engineering problems. Microcomputers in Civil Engineering. 12(4):1997;307-322.
2. Reich Y. Measuring the value of knowledge. International Journal of Human-Computer Studies. 42(1):1995;3-30.
3. Feelders A, Verkooijen W. Which method learns most from the data? In Preliminary papers of the Fifth International Workshop on Artificial Intelligence and Statistics, 1995, pp. 219-225.
4. Geman S., Bienstock E., Doursat R. Neural networks and the bias/variance dilemma. Neural Computation. 4:(1):1992;1-58.
5. Kohavi R. A study of cross-validation and bootstrap for error estimation and model selection. In proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, 1995, pp. 1137-1143, Morgan Kaufmann.
6. Highleyman W. The design and analysis of pattern recognition experiments. Bell System Technical Journal. 41:(1962):1962;723-744.
7. Schaffer C. A conservation law for generalization performance. In Proceedings of the Eleventh International Conference on Machine Learning, 1997, pp. 259-265, Morgan Kaufmann.
8. Wolpert D.H. The lack of a priori distinctions between learning algorithms. Neural Computation. 8:1996;1341-1390.
9. Kohavi R, Wolpert DH. Bias plus variance decomposition for zero-one loss functions. In Proceedings of the Thirteenth International Conference on Machine Learning, Morgan Kaufmann, 1996.
10. Bailey TL, Elkan C. Estimating the accuracy of learned concepts. In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, 1993, pp. 895-900, Morgan Kaufmann.
11. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and Regression Trees, Belmont, Waldsworth, CA, 1984.
12. Dietterich TG. Statistical tests for comparing supervized classification learning algorithms. Technical report, Department of Computer Science, Oregon State University, 1996.
13. Efron B. Estimating the error rate of a prediction rule: Improvement on cross-validation. Journal of the American Statistical Association. 78:(382):1983;316-331.
14. Efron B., Tibshirani R. An Introduction to the Bootstrap. 1993;Chapman and Hall, New York, NY.
15. Flexer A. Statistical evaluation of neural network experiments: minimum requirements and current practice. In Trappl R, editor, Proceedings of the Thirteenth European Meeting on Cybernetics and Systems Research, 1995, pp. 1005-1008, Vienna, Austria, Austrian Society for Cybernetic Studies.
16. Jain A.K., Dubes R.C., Chen C. Bootstrap techniques for error estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence. PAMI 9:(5):1987;628-633.
17. Breiman L. Heuristics of instability and stabilization. The Annals of Statistics. 24:(6):1996;2350-2383.
18. Henry R.J. Methods of comparison. Michie D., Spiegelhalter D., Taylor C.C. Machine Learning, Neural and Statistical Classification. 1994;107-124 Ellis Horwood Publishers, Chichester, England.
19. Michie D., Spiegelhalter D., Taylor C.C. Machine Learning, Neural and Statistical Classification. 1994;Ellis Horwood Publishers, Chichester, England.
20. Weiss SM, Kapouleas I. An empirical comparison of pattern recognition, neural nets, and machine learning classification methods. In Proceedings of The Eleventh International Joint Conference on Artificial Intelligence, Detroit, MI, San Mateo, CA, Morgan Kaufmann, 1989, pp. 781-787.
21. Stine R.A. An introduction to bootstrap methods. Sociological Methods and Research. 18:1990;243-291.
22. Gascuel P, Carauz G, Statistical significance in inductive learning. In Neumann B, editor, Proceedings of the 10th European Conference on Artificial Intelligence, New York, NY, Wiley, 1992, pp. 435-439.
23. Weiss S.M. Small sample error rate estimation for k-nearest neighbor classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence. 13:(3):1991;285-289.
24. Shao J. Linear model selection via cross validation. Journal of the American Statistical Association. 88:(422):1993;486-494.
25. Stone M. Asymptotics for and against cross-validation. Biometrika. 64(1):1977;29-35.
26. Denny S.B., Puckette L.T., Hubble E.N., Smith S.K., Najarian R.F. A new usable propeller series. Marine Technology. 26(3):1989;173-191.
27. Neocleous CC, Schizas CN. Artificial neural networks in marine propeller design. In Proceedings of ICNN'95-International Conference on Neural Networks, New York, NY, IEEE Computer Society Press, Vol. 2 (1995) 1098-1102.
28. Demuth H, Beale M. Neural Networks Toolbox-For Use with MATLAB, The Mathworks Inc. Natick, MA, 1994.
29. Morrison D.F. Multivariate Statistical Methods. 3 :1990;McGraw-Hill, New York, NY.
30. Congleton J., Berrisford R., Yang W. Stress corrosion cracking of sensitized type 304 stainless steel in doped high-temperature water. Corrosion Science. 51:(12):1995;901-910.
31. Weiss SM, Indurkhya N. Decision tree pruning: Biased or optimal? In Proceedings of the 12th National conference on AI, 1994, pp. 626-632, AAAI Press.
32. Prechelt L. A quantitative study in experimental evaluation of neural network learning algorithms: Current research practice. Neural Networks. 9:(3):1996;457-462.
33. Winer B.J. Statistical Principles in Experimental Design. 1962;McGraw-Hill, New York, NY.
34. Hays W.L. Statistics. 4 :1988.
35. Welch B.L. The generalization of Student's problem when several different population variances are involved. Biometrika. 34:1947;28-35.
36. Gama J, Brazdil J, Characterization of classification algorithms. In Pinto-Ferreira C, Mameda N, editors. Progress in Artificial Intelligence, 7th Portuguese Conference on Artificial Intelligence, EPIA-95, 1995, pp. 189-200, Berlin, Springer Verlag.