Threefold vs. fivefold cross validation in one-hidden-layer and two-hidden-layer predictive neural network modeling of machining surface roughness data

Journal of Manufacturing Systems

Volumn 24, Issue 2, 2005, Pages 93-107

  Jack Feng, Chang Xue ^a   Yu, Zhi Guang Samuel ^a   Kingi, Unnati ^a   Pervaiz Baig, M ^a  

^a BRADLEY UNIVERSITY   (United States)

Author keywords

Cross validation; Data mining; ISO 13565; Machining surface roughness; Neural networks; Predictive modeling

Indexed keywords

CROSS VALIDATION; ISO 13565; MACHINING SURFACE ROUGHNESS; PREDICTIVE MODELING;

COMPUTER AIDED MANUFACTURING; COMPUTER SIMULATION; DATA MINING; NEURAL NETWORKS; PREDICTIVE CONTROL SYSTEMS; STATISTICAL METHODS;

MACHINING;

EID: 33745737321     PISSN: 02786125     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0278-6125(05)80010-X     Document Type: Article

References (51)

1. Allen D.M. The relationship between variable selection and data augmentation and a method for prediction. Technometrics v16 n1 (1974) 125-127
2. Bishop C.M. Neural Networks for Pattern Recognition (1995), Clarendon Press, Oxford, UK
3. Bounds D.G., Lloyd P.J., and Mathew B. A multilayer perceptron network for the diagnosis of low back pain. Proc. of 2nd IEEE Annual Int'l Conf. on Neural Networks. San Diego (1988), IEEE Press, Piscataway, NJ II.481-II.489
4. Box G.E.P., and Draper N.R. Empirical Model-Building and Response Surfiices (1987), John Wiley & Sons, New York
5. Box G.E.P., Hunter J.S., and Hunter W.G. Statistics fbr Experimenters: Design, Innovation, and Discovery. 2nd ed. (2005), John Wiley & Sons, New York
6. Breiman L. The little bootstrap and other methods for dimensionality selection in regression: X-fixed prediction error. Journal of the American Statistical Association v87 n419 (1992) 738-754
7. Breiman L., and Spector P. Submodel selection and evaluation in regression: the X-random case. Int'l Statistics Review v60 n3 (1992) 291-319
8. (Mar./Apr.). Burke L. Assessing a neural net: validation procedures. PC AI (1993) 20-24
9. Burman P. A comparative study of ordinary cross-validation, ν-fold cross-validation and the repeated learning-testing methods. Biometrika v76 n4 (1989) 503-514
10. A, Part 3. Burman P. Estimation of optimal transformations using v-fold cross validation and repeated learning-testing methods. Sankhva: The Indian Journal of Statistics v52 (1990) 314-345
11. Chester D.L. Why two hidden layers are better than one?. Proc. of 4th IEEE Annual Int'l Conf. on Neural Networks. Washington, DC (1990), IEEE Press, Piscataway, NJ I.265-I.268
12. Coit D.W., Jackson B.T., and Smith A.E. Static neural network process models: considerations and case studies. Int'l Journal of Production Research v36 n11 (1998) 2953-2967
13. Cybenko G. Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals and Systems v2 n4 (1989) 303-314
14. Efron B. Estimating the error rate of a prediction rule: improvement on cross-validation. Journal of the American Statistical Association v78 n382 (1983) 316-331
15. Efron B., and Tibshirani R.J. An Introduction to the Bootstrap (1998), Chapman & Hall, London
16. Feng C.-X., and Wang X.-F. Subset selection in predictive modeling of CMM digitization uncertainty. Journal of Manufacturing Systems v21 n6 (2002) 419-439
17. Feng C.-X., and Wang X.-F. Surface roughness predictive modeling: neural networks versus regression. IIE Trans. v35 n1 (2003) 11-27
18. Feng C.-X., and Wang X.-F. Data mining applied to predictive modeling of the knurling process. IIE Trans. v36 n3 (2004) 253-263
19. (Also published as Technical Paper No. MS03-202). Feng C.-X., and Yu Z. Neural networks modeling of turning surface roughness parameters defined by ISO 13565. ransactions of NAMRI1SME v31 (2003), Society of Manufacturing Engineers, Dearborn, MI 467-474
20. Feng C.-X., Wang X.-F., and Yu Z. Neural networks modeling of honing surface roughness parameters defined by ISO13565. Journal of Manufacturing Systems v21 n5 (2002) 395-408
21. Feng C.-X., Yu Z., and Kusiak A. Selection and validation of predictive regression and neural networks models for data from designed experiments. IIE Trans. v38 n1 (2006) 13-24
22. Geman S., Bienenstock E., and Doursat R. Neural networks and the bias/variance dilemma. Neural Computation v4 n1 (1992) 1-58
23. George E.I. The variable selection problem. Journal of the American Statistical Association v95 n452 (2000) 1304-1307
24. Gershenfeld N. The Nature of Mathematical Modeling (1999), Cambridge Univ. Press, Cambridge, UK
25. Groth R. Data Mining: A Hands On Approach for Business Professionals (1998), Prentice-Hall, Upper Saddle River, NJ
26. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2001), Springer, New York
27. Ingrassia S., and Morlini I. Neural network modeling of small datasets. Technometrics v47 n3 (2005) 297-311
28. Geneva, Switzerland. ISO. Geometrical product specifications (GPS) - surface texture: profile method; surface having stratified functional properties - part 2: height characterization using linear material ratio. ISO 13565-2. 1st ed. (1996)
29. Kolen J.F., and Pollack J.B. Backpropagation is sensitive to initial conditions. Complex Systems v4 n3 (1990) 269-280
30. Kusiak A. Computational Intelligence in Design and Manufacturing (2000), John Wiley & Sons, New York
31. Lawrence J. Introduction to Neural Networks: Design, Theory and Applications. 6th ed. (1994), California Scientific Software, Nevada City, CA
32. Lawrence J., and Fredrickson J. BrainMaker User's Guide and Reference Manual. 7th ed. (1998), California Scientific Software, Nevada City, CA
33. L, cross-validation and generalized cross-validation: discrete index set. The Annals of Statistics v15 n3 (1987) 958-975
34. Marchandani G., and Cao W. On hidden nodes for neural nets. IEEE Trans. on Circuits and Systems v36 n5 (1989) 661-664
35. Minitab. Minitab Release 13 User's Manual (2000), Minitab Inc., State College, PA
36. Mitchell T.M. Machine Learning (1997), McGraw-Hill, New York
37. Montgomery D.C. Design and Analysis of Experiments. 6th ed. (2005), John Wiley & Sons, New York
38. Montgomery D.C., and Ranger C.M. Applied Statistics and Probability for Engineers. 3rd ed. (2003), John Wiley & Sons, New York
39. Shao J. Linear model selection by cross-validation. Journal of the American Statistical Association v88 n422 (1993) 486-494
40. Snee R.D. Validation of regression models: methods and examples. Technometrics v19 n4 (1977) 415-428
41. Stone M. Cross- validatiry choice and assessment of statistical predictions (with discussions). Journal of Royal Statistical Society v36 n2 (1974) 111-147
42. Stone M. An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion. Journal of Royal Statistical Society v39 n1 (1977) 44-47
43. Swingler K. Applying Neural Networks: A Practical Guide (1996), Morgan Kaufmann Publishers, San Francisco
44. Tibshirani R. A comparison of some error estimates for neural network models. Neural Computation v8 n2 (1996) 152-163
45. Twomey J.M., and Smith A.E. Bias and variance of validation methods for function approximation neural networks under conditions of sparse data. IEEE Traits. on Systems, Man and Cybernetics, Part C v28 n3 (1998) 417-430
46. Wasserman P.D. Neural Computing: Theory and Practice (1989), Van Nostrand Reinhold, New York
47. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations (2000), Morgan Kaufmann Publishers, San Francisco
48. Wit C.F.J., and Hamada M. Experiments: Planning, Analysis, and Parameter Design Optimization (1998), John Wiley & Sons, New York
49. Zhang P. Model selection via multifold cross-validation. Annals of Statistics v21 n1 (1993) 299-331
50. Zhu H., and Rohwer R. No free lunch for cross-validation. Neural Computation v8 n6 (1996) 1421-1426
51. Yu Z.-G. Selection and validation of predictive regression and neural networks models for experimental data from machining surface roughness studies. MS thesis (2003), Dept. of Industrial & Mfg. Engg. & Technology, Bradley Univ., Peoria, IL