Automatic learning using neural networks and adaptive regression

Measurement and Control

Volumn 32, Issue 9, 1999, Pages 270-274

  Pham, D T ^a   Peat, B J ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; C (PROGRAMMING LANGUAGE); ERROR ANALYSIS; FEEDFORWARD NEURAL NETWORKS; MATHEMATICAL MODELS; MULTILAYER NEURAL NETWORKS; REGRESSION ANALYSIS; TENSORS;

GENERALIZED CROSS-VALIDATED (GCV); MULTIVARIATE ADAPTIVE REGRESSION SPLINES (MARS);

LEARNING SYSTEMS;

EID: 0033348590     PISSN: 00202940     EISSN: None     Source Type: Journal    
DOI: 10.1177/002029409903200904     Document Type: Article

References (51)

1. Barnard E & Casasent D, Invariance and Neural Nets, IEEE Trans. on Neural Networks, Vol. 2, No. 5, Sept 1991, pp. 498-508.
2. Bates D M & Watts D G (1988), Non-Linear Regression Analysis and Its Applications, Wiley, 1988.
3. Bishop C M, Neural Networks for Pattern Recognition, Oxford Univ Press, 1995.
4. Breiman L, Friedman J H, Olshen R A & Stone C J, Classification and Regression Trees, Chapman & Hall, 1984.
5. Bridle J S, Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition. In: Fogleman Soulie F & Herault J (eds), Neurocomputing: Algorithms, Architectures and Applications, Springer-Verlag, 1990, pp. 227-236.
6. Bridle J S, Training Stochastic Model Recognition Algorithms as Networks Can Lead to Maximum Mutual Information Estimation of Parameters. In: Touretzky D S (ed), Advances in Neural Information Processing Systems 2, Morgan Kaufmann, 1990, pp. 211-217.
7. Craven M W & Shavlik J W, (1993). Learning Symbolic Rules Using Artificial Neural Networks. In: Procs of 10th Intl Conf on Machine Learning, Univ of Massachusetts, June 27-29 1993, Morgan Kaufmann, pp. 73-80.
8. Denker J S & Le Cun Y, Transforming Neural-Net Output Levels to Probability Distributions. In: Lippmann R P, Moody J E & Touretzky D S (eds), Advances in Neural Information Processing Systems 3, Morgan Kaufmann, 1991, pp. 853-859.
9. De Veaux R D, Schumi J, Schweinsberg J & Ungar L H, Prediction intervals for neural networks via nonlinear regression, Technometrics, Vol.40, 1998, pp. 273-282.
10. Duda R D & Hart P E, Pattern Classification and Scene Analysis, Wiley, 1973.
11. Fahlman S E, Faster Learning Variations on Back-Propagation: An Empirical Study. In: Touretzty D, Hinton G & Sejnowski T (eds), Procs of 1988 Connectionist Models Summer School, Pittsburg, Morgan Kaufmann, 1989, pp. 38-51.
12. Fahlman S E & Lebiere C, The Cascade Correlation Learning Architecture. In: Touretzky D S (ed), Advances in Neural Information Processing Systems 2, Morgan Kaufmann, 1990, pp. 524-532.
13. Friedman J H, Multivariate Adaptive Regression Splines, Annals of Statistics, Vol. 19, No. 1, 1991, pp. 1-141.
14. Friedman J H, Adaptive Spline Networks. In: Lippmann R P, Moody J E & Touretzky D S (eds), Advances in Neural Information Processing Systems 3, Morgan Kaufmann, 1991, pp. 675-683.
15. Friedman J H, A Micro User's Guide to MARS Version 3.6, Stanford Univ, 1993.
16. Gallant S I, Connectionist Expert Systems, Communications of the ACM, Vol. 31, No. 2, Feb 1988, pp. 152-169.
17. Gill P E, Murray W & Wright M H, Practical Optimization, Academic Press, 1981.
18. Goutte C, Note on free lunches and cross-validation, Neural Computation, Vol. 9, 1997, pp. 1211-1215,
19. Hardle W, Applied Nonparametric Regression, Cambridge Univ Press, 1990.
20. Hassibi B & Stork D G, Second Order Derivatives for Network Pruning: Optimal Brain Surgeon. In: Hanson S J, Cowan J D & Giles C L (eds), Advances in Neural Information Processing Systems 5, Morgan Kaufmann, 1993, pp. 164-171.
21. Hastie T J & Tibshirani R J, Generalized Additive Models, Chapman & Hall, 1990.
22. Hastie T, Tibshirani R & Buja A, Flexible Discriminant Analysis by Optimal Scoring, Journal of American Statistical Assoc'n, Vol. 89, No. 428, Dec 1994, pp. 1255-1270.
23. Haykin S, Neural Networks: A Comprehensive Foundation, Macmillan, 1994.
24. Heskes T, Practical confidence and prediction intervals. In: Mozer M C, Jordan M I & Petsche T (eds), Advances in Neural Information Processing Systems 9, MIT Press, 1997, pp. 176-182.
25. Hertz J, Krogh A & Palmer R G, Introduction to the Theory of Neural Computation, Addison-Wesley, 1991.
26. Jacobs M C, Increased Rates of Convergence Through Learning Rate Adaption, Neural Networks, Vol. 1, 1988, pp. 295-307.
27. Kleinbaum D G et al, Applied regression analysis and other multivariable methods, 3rd ed, Duxbury Press, 1998.
28. Koene R A & Takane Y, Discriminant Component Pruning: Regularization and Interpretation of Multilayer Backpropagation Networks, Neural Computation, Vol. 11, 1999, pp. 783-802.
29. Looney C G, Pattern Recognition Using Neural Networks: Theory and Algorithms for Engineers and Scientists, Oxford Univ Press, 1997.
30. Maren A J, Harston C T & Pap R M, Handbook of Neural Computing Applications, Academic Press, 1990.
31. ++, Academic Press, 1993, with software.
32. Moody J E, The Effective Number of Parameters: An Analysis of Generalization and Regularization in Nonlinear Learning Systems. In: Moody J E, Hanson S J & Lippman R P (eds), Advances in Neural Infor'n Processing Systems 4, Morgan Kaufmann, 1992, pp. 847-854.
33. Pham D T & Alcock R J, Automated Grading and Defect Detection: A Review, Forest Product Journals, Vol. 48, No. 4, 1998, pp. 34-42.
34. Pham D T, Jennings N R & Ross I, Intelligent Visual Inspection of Valve-Stem Seals, Control Engineering Practice, Vol. 3, No. 9, 1995, pp. 1237-1245.
35. Pham D T & Peat B J, Hybrid Method for Systems Analysis, IEE Procs: Science, Measurement & Technology, Vol. 142, No. 5, Sept 1995, Special Issue on Manufacturing Eng'g, pp. 350-361.
36. Pham D T & Pham P T N, Artificial Intelligence in Engineering, Intl Journal of Machine Tools & Manufacture, Vol. 39, 1999, pp. 937-949.
37. Reed R, Pruning Networks - A Survey, IEEE Trans on Neural Networks, Vol. 4, No. 5, Sept 1993, pp. 740-747.
38. Richard M D & Lippmann R P, Neural Network Classifiers Estimate Bayesian a posteriori Probabilities, Neural Computation, Vol. 3, 1991, pp. 461-483.
39. Ripley B D, Statistical Aspects of Neural Networks. In: Bamdorff-Nielsen, Jensen & Kendall (eds), Networks and Chaos -Statistical and Probabilistic Aspects, Chapman & Hall, 1993, pp. 40-123.
40. Ripley B D, Pattern Recognition and Neural Networks, Cambridge Univ Press, 1996.
41. Ruck D W, Rogers S K, Kabrisky M, Oxley M E & Suter B W, The Multilayer Perceptron as an Approximation to a Bayes Optimal Discriminant Function, IEEE Trans. on Neural Networks, Vol. 1, No. 4, Dec 1990, pp. 296-298.
42. Rumelhart D E, Hinton G E & Williams R J, Learning Internal Representations by Error Propagation. In: Rumelhart D E, McCelland J L & PDP Research Group, Parallel Distributed Processing, Vol. 1: Foundations, MIT Press, 1986, pp. 318-362.
43. Ryan T P, Modem regression methods, Wiley, 1997.
44. Sarte W S, Neural Network Implementation in SAS Software, Procs. of 19th Annual SAS Users Group Intl Conf, April 1994, (revised 21 April).
45. Tibshirani R, A comparison of some error estimates for neural network models, Neural Computation, Vol. 8, 1996, pp. 152-163.
46. Towell G G & Shavlik J W, Knowledge-Based Artificial Neural Networks, Artificial Intelligence, Vol. 70, 1994, pp. 119-165.
47. Wan E A, Neural Network Classification: A Bayesian Interpretation, IEEE Trans. on Neural Networks, Vol. 1, No. 4, Dec 1990, pp. 303-305.
48. Weiss S M & Kulikowski C A, Computer Systems that Leam: Classification and Prediction Methods from Statistics, Neural Nets, Machine Leaming, and Expert Systems, Morgan Kaufmann, 1991.
49. White H, Artificial Neural Networks: Approximation and Leaming Theory, Blackwell, 1992.
50. Weisberg S, Applied Linear Regression, 2nd ed, Wiley, 1985.
51. Zhu H & Rohwer R, No free lunch for cross-validation, Neural Computation, Vol. 8, 1996, pp. 1421-1426.