Remarks on the use of multilayer perceptrons for the analysis of chemical sensor array data

IEEE Sensors Journal

Volumn 4, Issue 3, 2004, Pages 355-363

  Pardo, Matteo ^a   Sberveglieri, Giorgio ^a  

^a UNIVERSITY OF BRESCIA   (Italy)

Author keywords

Chemical sensors; Complexity control; Data analysis; Electronic nose (e nose); Multilayer perceptrons; Overfitting

Indexed keywords

APPROXIMATION THEORY; COMPUTATION THEORY; DATA REDUCTION; ERROR ANALYSIS; LEARNING SYSTEMS; MULTILAYER NEURAL NETWORKS;

COMPLEXITY CONTROL; ELECTRONIC NOSE; OVERFITTING; PARAMETRIC LEARNING;

CHEMICAL SENSORS;

EID: 2542458403     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2004.827207     Document Type: Article

References (44)

1. C. M. Bishop, Neural Networks for Pattern Recognition, Oxford, U.K.: Oxford Univ. Press, 1995.
2. A. Webb, Statistical Pattern Recognition. London, U.K.: Arnold, 1999.
3. H. Demuth and M. Beale, Manual of the Neural Network Toolbox. Natick, MA: The MathWorks, 1998. version 3.
4. M. Pardo and G. Sberveglieri, "Learning from data: A tutorial with emphasis on modern pattern recognition methods," IEEE Sensor J., vol. 2, pp. 203-217, June 2002.
5. S. Lawrence, C. L. Giles, and A. C. Tsoi, "Lessons in neural network training: Overfitting may be harder than expected," in Proc. 14th Nat. Conf. Artificial Intelligence. Menlo Park, CA, 1997, pp. 540-545.
6. R. Reed, "Pruning algorithms a survey," IEEE Trans. Neural Networks, vol. 4, pp. 740-747, Oct. 1993.
7. Y. LeCun, J. Denker, S. Solla, R. E. Howard, and L. D. Jackel, "Optimal brain damage," in Advances in Neural Information Processing Systems II, D. S. Touretzky, Ed. San Mateo, CA:Morgan Kauffman, 1990.
8. B. Hassibi and D. G. Stork, "Second order derivatives for network pruning: Optimal brain surgeon," in Advances in Neural Information Processing Systems. San Mateo, CA: Morgan Kaufmann, 1993, vol. 5, pp. 164-171.
9. S. Lawrence, C. L. Giles, and A. C. Tsoi, "What size neural network gives optimal generalization? Convergence properties of backpropagation," Inst. Advanced Computer Studies, Univ. Maryland, College Park, MD 20742, Tech. Rep. UMIACS-TR-96-22 and CS-TR-3617, Apr. 1996.
10. D. J. C. MacKay, "Bayesian interpolation," Neural Comput., vol. 4, pp. 415-447, 1992.
11. F. D. Foresee and M. T. Hagan, "Gauss-newton approximation to bayesian regularization," in Proc. Int. Joint Conf. Neural Networks, 1997, pp. 1930-1935.
12. J. E. Moody, "The effective number of parameters: An analysis of generalization and regularization in nonlinear learning systems," in Advances in Neural Information Processing Systems. San Mateo, CA: Morgan Kauffman, 1992, vol. 4, pp. 847-854.
13. J. Gardner and P. Bartlett, Electronic Noses. Oxford, U.K.: Oxford Univ. Press, 1999.
14. P. C. Jurs, G. A. Bakken, and H. E. McClelland, "Computational methods for the analysis of chemical sensor array data from volatile analytes," Chem. Rev., vol. 100, no. 2, pp. 2649-2678, 2000.
15. D. T. Manallack and D. J. Livingstone, "Statistics using neural networks: Chance effects," J. Med. Chem., vol. 36, pp. 1295-1297, 1993.
16. D. Rebière, C. Bordieu, and J. Pistré, "Improvement of surface acoustic wave gas sensor response time using neural-network pattern recognition," Sens. Actuators B, vol. 25, pp. 777-780, 1995.
17. R. M. Negri and S. Reich, "Identification of pollutant gases and its concentrations with a multisensor array," Sens. Actuators B, vol. 75, no. 3, pp. 172-178, 2001.
18. D.-S. Lee, H.-Y. Jung, J.-W. Lim, M. Lee, S.-W. Ban, J.-S. Huh, and D.-D. Lee, "Explosive gas recognition system using thick film sensor array and neural network," Sens, Actuators B, vol. 71, no. 1-2, pp. 90-98, 2000.
19. T. Nakamoto and H. Hiramatsu, "Study of odor recorder for dynamical change of odor using qcm sensors and neural network," Sens. Actuators B, vol. 85, no. 3, pp. 263-269, 2002.
20. V. Guidi, B. Yang, M. C. Carotta, M. Ferroni, G. Martinelli, G. Sberveglieri, and G. Faglia, "Quantification of h2s and no2 using gas sensor arrays and an artificial neural network," Sens. Actuators B, vol. 43, pp. 235-238, 1997.
21. K. Brudzewski and S. Osowski, "Gas analysis system composed of a solid-state sensor array and hybrid neural network structure," Sens. Actuators B, vol. 55, pp. 38-46, 1999.
22. J. C. Chen, C. J. Liu, and Y. H. Ju, "Determination of the composition of no2 and no mixture by thin-film sensor and back-propagation network," Sens. Actuators B, vol. 62, no. 2, pp. 143-147, 2000.
23. F. Despagne and L. Massart, "Neural networks in multivariate calibration," The Analyst, vol. 123, pp. 157R-178R, 1998.
24. W. S. Sarle, "Stopped training and other remedies for overfitting," in Proc. 27th Symp. Interface of Computing Science and Statistics, 1995, ftp://ftp.sas.com/pub/neural/inter95.ps.Z, pp. 352-360.
25. W. Sarle. Ai Faq/Neural Nets. [Online]. Available: http://www.faqs.org/ faqs/ai-faq/neural-nets/
26. R. Caruana, S. Lawrence, and C. L. Giles, "Overfitting in neural networks: Backpropagaiion, conjugale gradient, and early slopping," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2001, vol. 13, pp. 402-408.
27. S. Lawrence and C. L. Giles, "Overfitting and neural networks: Conjugate gradient and backpropagation," in Proc. IEEE Int. Conf. Neural Networks, 2000, pp. 114-119.
28. S. Lawrence, A. C. Tsoi, and A. D. Back, "Function approximation with neural networks and local methods: Bias, variance and smoothness," in Australian Conf. Neural Networks, 1996, pp. 16-21.
29. E. Bienenstock, S. Geman, and R. Doursat, "Neural networks and the bias/variance dilemma," Neural Comput., vol. 4, pp. 1-58, 1992.
30. A. Krogh and J. A. Hertz, "A simple weight decay can improve generalization," in Advances in Neural Information Processing Systems. San Mateo, CA: Morgan Kaufmann, 1992, vol. 4, pp. 950-957.
31. A. S. Weigend, D. E. Rumelhart, and B. A. Huberman, "Generalization by weight-elimination with application to forecasting," in Advances in Neural Information Processing Systems. San Mateo, CA: Morgan Kauffman, 1991, vol. 3.
32. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer, 1995.
33. _, Statistical Learning Theory. New York: Wiley, 1998.
34. B. Scholkopf and A. Smola, Learning with Kernels. Cambridge, MA: MIT Press, 2002.
35. N. Cristianini and J. Shawe-Taylor, Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, 2000.
36. C. Surges, "A tutorial on support vector machines for pattern recognition," in Data Mining and Knowledge Discovery. Norwell, MA: Kluwer, 1998, vol. 2, pp. 1-43.
37. A. I. Belousov, S. A. Verzakov, and J. von Frese, "A flexible classification approach with optimal generalization performance: Support vector machines," Chemometr. Intell. Lab. Syst., vol. 64, pp. 15-25, 2002.
38. M. Pardo, E. Dalcanale, and G. Sberveglieri, "A general framework for learning from data and an application to three electronic nose datasets," in 7th Int. Symp. Olfaction and Electronic Nose, Brighton, U.K., July 2000.
39. M. Pardo and G. Sberveglieri, "Support vector machines for the classification of electronic nose data," in 8th Int. Symp. Chemometrics in Analytical Chemistry, Seattle, 2002.
40. P. L. Bartlett, "The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network," IEEE Trans. Inform. Theory, vol. 44, pp. 525-536, Mar. 1998.
41. G. Sberveglieri, "Recent developments in semiconducting film gas sensors," Sens. Actuators B, vol. 23, pp. 103-109, 1995.
42. M. Pardo and G. Sberveglieri, "Coffee analysis with an electronic nose," IEEE Trans. Instrum. Meas., vol. 51, pp. 1334-1339, Dec. 2002.
43. C. J. Merz and P. M. Murphy. (1998) UCI repository of machine learning databases. [Online]. Available: www.ics.uci.edu/mleam/ML-Repository.html
44. M. T. Hagan and M. Menhaj, "Training feedforward networks with the marquardt algorithm," IEEE Trans. Neural Networks, pp. 989-993, Oct. 1994.