Combining diverse neural nets

Knowledge Engineering Review

Volumn 12, Issue 3, 1997, Pages 231-247

  Sharkey, Amanda J C ^a   Sharkey, Noel E ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER HARDWARE; COMPUTER SOFTWARE; LEARNING SYSTEMS;

NEURAL COMPUTING;

NEURAL NETWORKS;

EID: 0031224574     PISSN: 02698889     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0269888997003123     Document Type: Article

References (44)

1. Adams, JM and Taha, A, 1992. "An experiment in software redundancy with diverse methodologies" Proc. Twenty-Fifth Hawaii International Conference on Systems Sciences.
2. Banisoleiman, K, Smith, LA and Matheieson, N, 1993. "Simulation of diesel engine performance" Trans. Institute of Marine Engineers 105(3) 117-135.
3. Boek, MJ, 1991. "Experiments in the application of neural networks to rotating machine fault diagnosis" Proc. IEEE International Joint Conference on Neural Networks Singapore, 769-774.
4. Breiman, L, 1992. "Stacked Regression" Dept. of Statistics, Berkeley, Technical Report no 367.
5. Breiman, L, 1994. "Bagging predictors" Technical Report, UC Berkeley, 1994.
6. Croll, PR, Sharkey, AJC, Bass, JM, Sharkey, NE and Fleming, PJ, 1995. "Dependable intelligent voting for real-time control software" Engineering Applications of Artificial Intelligence 8(6) 615-623.
7. Denker, J, Schwartz, D, Wittner, B, Solla, S, Howard, R, Jackel, L and Hopfield, J, 1987. "Large automatic learning, rule extraction and generalisation" Complex Systems 1 877-922.
8. Drucker, H, Cortes, C, Jackel, LD, LeCun, Y and Vapnik, V, 1994. "Boosting and other ensemble methods" Neural Computation 6 1289-1301.
9. Duyar, A and Merrill, W, 1992. "Fault diagnosis for the space shuttle main engine" Journal of Guidance, Control and Dynamics 15(2) 384-389.
10. Geman, S, Bienenstock, E and Doursat, R, 1992. "Neural networks and the bias/variance dilemma" Neural Computation 4(1) 1-58.
11. Gopinath, OC, 1994. "A neural net solution for diesel engine fault diagnosis" MSc thesis, University of Sheffield.
12. Granger, CWJ, 1989. "Combining forecasts - twenty years later" Journal of Forecasting 8(3) 167-173.
13. Hansen, LK and Salamon, P, 1990. "Neural network ensembles" IEEE Tran. Patterns Anal. Machine Intelligence 12(10) 993-1001.
14. Hashem, S, 1996. "Effects of collinearity on combining neural networks" Connection Science 8(3/4) 315-336.
15. Hashem, S and Schmeiser, B, 1993. "Approximating a function and its derivatives using MSE-optimal linear combinations of trained feedforward neural networks" Proc. Joint Conference on Neural Networks vol 87, 617-620, New Jersey.
16. Knight, JC and Leveson, NG, 1986. "An experimental evaluation of independence in multiversion programming" Trans. on Software Eng. 12(1).
17. Kolen, JF and Pollack, JB, 1990. "Backpropagation is sensitive to initial Conditions" TR 90-JK-BPSIC.
18. Krogh, A and Vedelsby, J, 1995. "Neural network ensembles, cross validation and active learning" In: G Tesauro, DS Touretzky and TK Leen, eds, Advances in Neural Information Processing Systems 7, MIT Press.
19. Lincoln, WP and Skrzypek, J, 1990. "Synergy of clustering multiple back propagation networks" In: Advances in Neural Information Processing Systems 2 650-657.
20. Littlewood, B and Miller, DR, 1989. "Conceptual modelling of coincident failures in multiversion software" IEEE Trans Software Engineering 15(12) 1596-1614.
21. MacIntyre, J, Smith, P, Harris, T. and Brason, A, 1993. "Application of neural networks to the analysis and interpretation of off-line condition monitoring data" Sixth International Symposium on Artificial Intelligence Monterrey (Mexico).
22. Marko, KA, James, JV, Feldkamp, TM, Puskorius, GV and Feldkamp, LA, 1996. "Signal processing by neural networks to create 'virtual' sensors and model-based diagnostics" Proc. ICANN 1996 Bochum, Germany.
23. Nilsson, NJ, 1965. Learning Machines: Foundations of Trainable Pattern-Classifying Systems McGraw Hill.
24. Opitz, DW and Shavlik, JW, 1996. "Actively searching for an effective neural network ensemble" Connection Science 8(3/4) 337-354.
25. Partridge, D and Griffith, N, 1995. "Strategies for improving neural net generalisation" Neural Computing and Applications 3 27-37.
26. Partridge, D and Yates, WB, 1996. "Engineering multiversion neural-net systems" Neural Computation 8(4) 869-893.
27. Perrone, MP and Cooper, LN, 1993. "When networks disagree: Ensemble methods for neural networks" In: RJ Mammone, ed., Neural Networks for Speech and Image Processing Chapman Hall.
28. Raviv, Y and Intrator, N, 1996. "Bootstrapping with noise: an effective regularization technique. Connection Science 8(3/4) 355-372.
29. Ramamoorthy, CV, Mok, YR, Bastani, EB, Chin, GH and Suzuki, K, 1981. "Application of a methodology for the development and validation of reliable process control software" IEEE Trans. Software Eng. 7 537-555.
30. Rogova, G, 1994. "Combining the results of several neural network classifiers" Neural Networks 7(5) 777-781.
31. Rumelhart, DE, Hinton, GE and Williams, RJ, 1986. "Learning internal representations by error propagation" In: DE Rumelhart and JL McClelland, eds., Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol 1: Foundations MIT Press.
32. Sharkey, AJC and Sharkey, NE, 1997. "Diversity, selection and ensembles of artificial neural nets" In: Proc. Third International Conference on Neural Networks and their Applications: IUSPIM Marseilles, France, pp. 205-212.
33. Sharkey, AJC, 1996. "On combining artificial neural nets" Connection Science 8(3/4) 299-314.
34. Sharkey, AJC, Sharkey, NE and Chandroth, GO, 1996. "Diverse neural net solutions to a fault diagnosis problem" Neural Computing and Applications 4 218-227.
35. Sharkey, AJC and Sharkey, NE, 1995a. "Cognitive modelling: psychology and connectionism" In: MA Arbib ed., The Handbook of Brain Theory and Neural Networks Bradford Books/MIT Press, pp. 200-203.
36. Sharkey, AJC and Sharkey, NE, 1995b. "How to improve the reliability of artificial neural networks" Research Report CS-95-11, Department of Computer Science, University of Sheffield.
37. Sharkey, NE and Sharkey, AJC, 1995c. "An analysis of catastrophic interference" Connection Science 7(3 & 4) 301-329.
38. Sharkey, NE, Neary, J and Sharkey, AJC, 1995. "Searching weight space for backpropagation solution types" In: LF Niklasson and MB Boden, eds., Current Trends in Connectionism: Proceedings of the 1995 Swedish Conference on Connectionism, Lawrence Erlbaum, pp. 103-120.
39. Sharkey, NE and Partridge, DP, 1992. "The statistical independence of network generalisation: an application in software engineering" In: PG Lisboa and MJ Taylor, eds., Neural Networks: Techniques and Applications Ellis Horwood.
40. Tumer, K and Ghosh, J, 1996. "Error correlation and error reduction in ensemble classifiers" Connection Science 8(3/4) 385-404.
41. White, H, Hornik, K and Stinchcombe, M, 1992. "Multilayer feedforward networks are universal approximators" In: H White, ed., Artificial Neural Networks: Approximation and Learning Theory Blackwell.
42. Wolpert, DH, 1992. "Stacked generalisation" Neural Networks 5(2) 241-259.
43. Worden, K, 1997. "Structural fault detection using a novelty measure" Journal of Sound and Vibration 201(1) 85-101.
44. Xu, L., Krzyzak, A and Suen, CY, 1992. "Methods of combining multiple classifiers and their applications to handwriting recognition" IEEE Trans. Systems, Man and Cybernetics 22(3) 418-435.