Global sensitivity estimates for neural network classifiers

IEEE Transactions on Neural Networks and Learning Systems

Volumn 28, Issue 11, 2017, Pages 2592-2604

  Fernández Navarro, Francisco ^a   Carbonero Ruz, Mariano ^a   Alonso, David Becerra ^a   Torres Jimenez, Mercedes ^a  

^a UNIVERSIDAD LOYOLA ANDALUCÍA   (Spain)

Author keywords

Feedforward neural networks; Functional decomposition; Global sensitivity analysis (GSA); Multiclassification; Product unit neural networks (PUNNs)

Indexed keywords

ANALYSIS OF VARIANCE (ANOVA); FUNCTIONS; NEURAL NETWORKS; RADIAL BASIS FUNCTION NETWORKS;

ANOVA DECOMPOSITIONS; APPROXIMATION CAPACITY; FUNCTIONAL DECOMPOSITION; GLOBAL SENSITIVITY; NEURAL NETWORK CLASSIFIER; PRODUCT UNIT NEURAL NETWORK; RADIAL BASIS FUNCTIONS; SENSITIVITY INDICES;

MONTE CARLO METHODS;

ANALYSIS OF VARIANCE; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFIER; DECOMPOSITION; MONTE CARLO METHOD; RADIAL BASIS FUNCTION;

EID: 84983050058     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2016.2598657     Document Type: Article

References (56)

1. M. Fukumi and N. Akamatsu, "A new rule extraction method from neural networks," in Proc. Int. Joint Conf. Neural Netw. (IJCNN), vol. 6. 1999, pp. 4134-4138.
2. R. Andrews, J. Diederich, and A. B. Tickle, "Survey and critique of techniques for extracting rules from trained artificial neural networks," Knowl.-Based Syst., vol. 8, no. 6, pp. 373-389, 1995.
3. J. Chorowski and J. M. Zurada, "Extracting rules from neural networks as decision diagrams," IEEE Trans. Neural Netw., vol. 22, no. 12, pp. 2435-2446, Dec. 2011.
4. P. D. Wasserman, Advanced Methods in Neural Computing. New York, NY, USA: Wiley, 1993.
5. S. Sestito and T. Dillon, "Knowledge acquisition of conjunctive rules using multilayered neural networks," Int. J. Intell. Syst., vol. 8, no. 7, pp. 779-805, 1993.
6. D. G. Garson, "Interpreting neural-network connection weights," AI Expert, vol. 6, no. 4, pp. 46-51, 1991.
7. S. Dreiseitl and L. Ohno-Machado, "Logistic regression and artificial neural network classification models: A methodology review," J. Biomed. Informat., vol. 35, nos. 5-6, pp. 352-359, 2002.
8. M.-S. Duh, A. M. Walker, and J. Z. Ayanian, "Epidemiologic interpretation of artificial neural networks," Amer. J. Epidemiol., vol. 147, no. 12, pp. 1112-1122, 1998.
9. D. J. Sargent, "Comparison of artificial neural networks with other statistical approaches," Cancer, vol. 91, no. S8, pp. 1636-1642, 2001.
10. J. D. Buckley, "Predicting time-to-relapse in breast cancer using neural networks," Univ. Southern California Los Angeles, DTIC Document, Tech. Rep., 1997.
11. P. K. Simpson, Neural Networks Applications. Piscataway, NJ, USA: IEEE Press, 1997.
12. F. Fernández-Navarro, P. Campoy-Muñoz, M. de la Paz-Marín, C. Hervás-Martínez, and X. Yao, "Addressing the EU sovereign ratings using an ordinal regression approach," IEEE Trans. Cybern., vol. 43, no. 6, pp. 2228-2240, Dec. 2013.
13. J. D. Olden and D. A. Jackson, "Illuminating the 'black box': A randomization approach for understanding variable contributions in artificial neural networks," Ecol. Model., vol. 154, nos. 1-2, pp. 135-150, 2002.
14. B. Cheng and D. M. Titterington, "Neural networks: A review from a statistical perspective," Statist. Sci., vol. 9, no. 1, pp. 2-30, 1994.
15. S. Hashem, "Sensitivity analysis for feedforward artificial neural networks with differentiable activation functions," in Proc. Int. Joint Conf. Neural Netw. (IJCNN), vol. 1. 1992, pp. 419-424.
16. P. J. G. Lisboa, A. R. Mehridehnavi, and P. A. Martin, "The interpretation of supervised neural networks," in Proc. Workshop Neural Netw. Appl. Tools, 1993, pp. 11-17.
17. Y. Dimopoulos, P. Bourret, and S. Lek, "Use of some sensitivity criteria for choosing networks with good generalization ability," Neural Process. Lett., vol. 2, no. 6, pp. 1-4, 1995.
18. A. P. Engelbrecht and I. Cloete, "A sensitivity analysis algorithm for pruning feedforward neural networks," in Proc. IEEE Int. Conf. Neural Netw., vol. 2. Jun. 1996, pp. 1274-1277.
19. A. P. Engelbrecht, "A new pruning heuristic based on variance analysis of sensitivity information," IEEE Trans. Neural Netw., vol. 12, no. 6, pp. 1386-1399, Nov. 2001.
20. A. P. Engelbrecht and I. Cloete, "Incremental learning using sensitivity analysis," in Proc. Int. Joint Conf. Neural Netw. (IJCNN), vol. 2. Jul. 1999, pp. 1350-1355.
21. R. H. Kewley, M. J. Embrechts, and C. Breneman, "Data strip mining for the virtual design of pharmaceuticals with neural networks," IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 668-679, May 2000.
22. M. J. Embrechts, F. A. Arciniegas, M. Ozdemir, and R. H. Kewley, "Data mining for molecules with 2-D neural network sensitivity analysis," Int. J. Smart Eng. Syst. Design, vol. 5, no. 4, pp. 225-239, 2003.
23. J. M. Zurada, A. Malinowski, and S. Usui, "Perturbation method for deleting redundant inputs of perceptron networks," Neurocomputing, vol. 14, no. 2, pp. 177-193, 1997.
24. M. Stevenson, R. Winter, and B. Widrow, "Sensitivity of feedforward neural networks to weight errors," IEEE Trans. Neural Netw., vol. 1, no. 1, pp. 71-80, Mar. 1990.
25. X. Zeng and D. S. Yeung, "Sensitivity analysis of multilayer perceptron to input and weight perturbations," IEEE Trans. Neural Netw., vol. 12, no. 6, pp. 1358-1366, Nov. 2001.
26. M. Li, "Robust optimization and sensitivity analysis with multi-objective genetic algorithms: Single-and multi-disciplinary applications," Ph.D. dissertation, Dept. Mech. Eng., Univ. Maryland, College Park, College Park, MD, USA, Nov. 2007.
27. A. Saltelli et al., Global Sensitivity Analysis: The Primer. New York, NY, USA: Wiley, 2008.
28. H. M. Wagner, "Global sensitivity analysis," Oper. Res., vol. 43, no. 6, pp. 948-969, 1995.
29. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their application to non-linear system identification," Int. J. Control, vol. 50, no. 5, pp. 1873-1896, 1989.
30. K. Z. Mao, "Fast orthogonal forward selection algorithm for feature subset selection," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1218-1224, Sep. 2001.
31. E. Fock, "Global sensitivity analysis approach for input selection and system identification purposes-A new framework for feedforward neural networks," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 8, pp. 1484-1495, Aug. 2014.
32. A. Saltelli, S. Tarantola, and K. P.-S. Chan, "A quantitative modelindependent method for global sensitivity analysis of model output," Technometrics, vol. 41, no. 1, pp. 39-56, 1999.
33. I. M. Sobol, "Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates," Math. Comput. Simul., vol. 55, nos. 1-3, pp. 271-280, 2001.
34. R. Durbin and D. E. Rumelhart, "Product units: A computationally powerful and biologically plausible extension to backpropagation networks," Neural Comput., vol. 1, no. 1, pp. 133-142, 1989.
35. I. M. Sobol, "On sensitivity estimation for nonlinear mathematical models," Matematicheskoe Modelirovanie, vol. 2, no. 1, pp. 112-118, 1990.
36. A. Ismail and A. P. Engelbrecht, "Pruning product unit neural networks," in Proc. Int. Joint Conf. Neural Netw., vol. 1. 2002, pp. 257-262.
37. F. J. Martínez-Estudilloa, C. Hervás-Martínez, P. A. Gutiérrez, and A. C. Martínez-Estudillo, "Evolutionary product-unit neural networks classifiers," Neurocomputing, vol. 72, nos. 1-3, pp. 548-561, 2008.
38. M. Torres, C. Hervás, and C. García, "Multinomial logistic regression and product unit neural network models: Application of a new hybrid methodology for solving a classification problem in the livestock sector," Expert Syst. Appl., vol. 36, no. 10, pp. 12225-12235, 2009.
39. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
40. G. S. Babu and S. Suresh, "Meta-cognitive RBF network and its projection based learning algorithm for classification problems," Appl. Soft Comput., vol. 13, no. 1, pp. 654-666, 2013.
41. A. Asuncion and D. Newman. (2007). UCI Machine Learning Repository. [Online]. Available: http://www.ics.uci.edu/mlearn/MLRepository.html
42. PASCAL. (2011). Pascal (Pattern Analysis, Statistical Modelling and Computational Learning) Machine Learning Benchmarks Repository.online . Available: http://mldata.org/
43. P. A. Gutiérrez et al., "Hybridizing logistic regression with product unit and RBF networks for accurate detection and prediction of banking crises," Omega, vol. 38, no. 5, pp. 333-344, Oct. 2010.
44. F. Fernández-Navarro, C. Hervás-Martínez, C. García-Alonso, and M. Torres-Jimenez, "Determination of relative agrarian technical efficiency by a dynamic over-sampling procedure guided by minimum sensitivity," Expert Syst. Appl., vol. 38, no. 10, pp. 12483-12490, 2011.
45. S. Ventura, C. Romero, A. Zafra, J. A. Delgado, and C. Hervás, "JCLEC: A Java framework for evolutionary computation," Soft Comput., vol. 12, no. 4, pp. 381-392, 2008.
46. M. Kendall, Rank Correlation Methods. London, U.K.: Griffin, 1948.
47. A. Marrel, B. Iooss, B. Laurent, and O. Roustant, "Calculations of Sobol indices for the Gaussian process metamodel," Rel. Eng. Syst. Safety, vol. 94, no. 3, pp. 742-751, 2009.
48. A. Marrel, B. Iooss, S. Da Veiga, and M. Ribatet, "Global sensitivity analysis of stochastic computer models with joint metamodels," Statist. Comput., vol. 22, no. 3, pp. 833-847, 2011.
49. J. D. Olden, M. K. Joy, and R. G. Death, "An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data," Ecol. Model., vol. 178, nos. 3-4, pp. 389-397, 2004.
50. I. M. Sobol, "On quasi-Monte Carlo integrations," Math. Comput. Simul., vol. 47, nos. 2-5, pp. 103-112, 1998.
51. F. Fernández-Navarro, A. Riccardi, and S. Carloni, "Ordinal regression by a generalized force-based model," IEEE Trans. Cybern., vol. 45, no. 4, pp. 844-857, Apr. 2015.
52. J. K. Ravalico, H. R. Maier, G. C. Dandy, J. P. Norton, and B. F. W. Croke, "A comparison of sensitivity analysis techniques for complex models for environment management," in Proc. 16th Int. Congr. Modelling Simulation, Melbourne, VIC, Australia, 2005, pp. 2533-2539.
53. R. I. Cukier, C. M. Fortuin, K. E. Shuler, A. G. Petschek, and J. H. Schaibly, "Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory," J. Chem. Phys., vol. 59, no. 8, pp. 3873-3878, 1973.
54. G. J. McRae, J. W. Tilden, and J. H. Seinfeld, "Global sensitivity analysis-A computational implementation of the Fourier amplitude sensitivity test (FAST)," Comput. Chem. Eng., vol. 6, no. 1, pp. 15-25, 1982.
55. F. Cannavó, "Sensitivity analysis for volcanic source modeling quality assessment and model selection," Comput. Geosci., vol. 44, pp. 52-59, Jul. 2012.
56. J. M. Benítez, J. L. Castro, and I. Requena, "Are artificial neural networks black boxes?" IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 1156-1164, 1997.