Lower upper bound estimation method for construction of neural network-based prediction intervals

IEEE Transactions on Neural Networks

Volumn 22, Issue 3, 2011, Pages 337-346

  Khosravi, Abbas ^a   Nahavandi, Saeid ^a   Creighton, Doug ^a   Atiya, Amir F ^b  

^a DEAKIN UNIVERSITY   (Australia)

^b CAIRO UNIVERSITY   (Egypt)

Author keywords

Neural network; prediction interval; simulated annealing; uncertainty

Indexed keywords

COMPUTATIONAL LOADS; COVERAGE PROBABILITIES; DATA DISTRIBUTION; HIGH QUALITY; OBJECTIVE FUNCTIONS; PREDICTION INTERVAL; QUANTITATIVE COMPARISON; SIMULATED ANNEALING METHOD; TRADITIONAL TECHNIQUES; UNCERTAINTY; UPPER AND LOWER BOUNDS; UPPER BOUND;

BENCHMARKING; ESTIMATION; FORECASTING; NEURAL NETWORKS;

SIMULATED ANNEALING;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; COMPUTER PROGRAM; PREDICTIVE VALUE;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); PREDICTIVE VALUE OF TESTS; SOFTWARE DESIGN;

EID: 79952186591     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2010.2096824     Document Type: Article

References (37)

1. C. P. I. J. van Hinsbergen, J. W. C. van Lint, and H. J. van Zuylen, "Bayesian committee of neural networks to predict travel times with confidence intervals," Trans. Res. Part C: Emerg. Technol., vol. 17, no. 5, pp. 498-509, Oct. 2009.
2. W.-H. Liu, "Forecasting the semiconductor industry cycles by bootstrap prediction intervals," Appl. Econ., vol. 39, no. 13, pp. 1731-1742, 2007. (Pubitemid 47180432)
3. A. Khosravi, S. Nahavandi, and D. Creighton, "A prediction intervalbased approach to determine optimal structures of neural network metamodels," Expert Syst. Appl., vol. 37, no. 3, pp. 2377-2387, Mar. 2010.
4. C. M. Bishop, Neural Networks for Pattern Recognition. London, U.K.: Oxford Univ. Press, 1995.
5. D. L. Shrestha and D. P. Solomatine, "Machine learning approaches for estimation of prediction interval for the model output," Neural Netw., vol. 19, no. 2, pp. 225-235, Mar. 2006.
6. S. L. Ho, M. Xie, L. C. Tang, K. Xu, and T. N. Goh, "Neural network modeling with confidence bounds: A case study on the solder paste deposition process," IEEE Trans. Electron. Packag. Manufact., vol. 24, no. 4, pp. 323-332, Oct. 2001. (Pubitemid 34126202)
7. J. H. Zhao, Z. Y. Dong, Z. Xu, and K. P. Wong, "A statistical approach for interval forecasting of the electricity price," IEEE Trans. Power Syst., vol. 23, no. 2, pp. 267-276, May 2008. (Pubitemid 351695804)
8. A. Khosravi, S. Nahavandi, and D. Creighton, "Construction of optimal prediction intervals for load forecasting problems," IEEE Trans. Power Syst., vol. 25, no. 3, pp. 1496-1503, Aug. 2010.
9. S. G. Pierce, K. Worden, and A. Bezazi, "Uncertainty analysis of a neural network used for fatigue lifetime prediction," Mech. Syst. Signal Process., vol. 22, no. 6, pp. 1395-1411, Aug. 2008.
10. D. F. Benoit and D. Van den Poel, "Benefits of quantile regression for the analysis of customer lifetime value in a contractual setting: An application in financial services," Expert Syst. Appl., vol. 36, no. 7, pp. 10475-10484, Sep. 2009.
11. N. Meade and T. Islam, "Prediction intervals for growth curve forecasts," J. Forecast., vol. 14, no. 5, pp. 413-430, Sep. 1995.
12. T. Heskes, "Practical confidence and prediction intervals," in Advances in Neural Information Processing Systems, vol. 9, T. P. M. Mozer and M. Jordan, Eds. Cambridge, MA: MIT Press, 1997, pp. 176-182.
13. J. G. De Gooijer and R. J. Hyndman, "25 years of time series forecasting," Int. J. Forecast., vol. 22, no. 3, pp. 443-473, 2006. (Pubitemid 44057710)
14. G. Chryssolouris, M. Lee, and A. Ramsey, "Confidence interval prediction for neural network models," IEEE Trans. Neural Netw., vol. 7, no. 1, pp. 229-232, Jan. 1996. (Pubitemid 126811745)
15. J. T. G. Hwang and A. A. Ding, "Prediction intervals for artificial neural networks," J. Amer. Stat. Assoc., vol. 92, no. 438, pp. 748-757, Jun. 1997.
16. C. J. Wild and G. A. F. Seber, Nonlinear Regression. New York: Wiley, 1989.
17. A. A. Ding and X. He, "Backpropagation of pseudo-errors: Neural networks that are adaptive to heterogeneous noise," IEEE Trans. Neural Netw., vol. 14, no. 2, pp. 253-262, Mar. 2003.
18. R. D. De Veaux, J. Schumi, J. Schweinsberg, and L. H. Ungar, "Prediction intervals for neural networks via nonlinear regression," Technometrics, vol. 40, no. 4, pp. 273-282, Nov. 1998. (Pubitemid 128631254)
19. T. Lu and M. Viljanen, "Prediction of indoor temperature and relative humidity using neural network models: Model comparison," Neural Comput. & Appl., vol. 18, no. 4, pp. 345-357, Mar. 2009.
20. A. Khosravi, S. Nahavandi, and D. Creighton, "Improving prediction interval quality: A genetic algorithm-based method applied to neural networks," in Proc. 16th Int. Conf. Neural Inf. Process.: Part II, vol. 5864. 2009, pp. 141-149.
21. D. J. C. MacKay, "The evidence framework applied to classification networks," Neural Comput., vol. 4, no. 5, pp. 720-736, Sep. 1992.
22. R. Dybowski and S. J. Roberts, "Confidence intervals and prediction intervals for feed-forward neural networks," in Clinical Applications of Artificial Neural Networks, R. Dybowski and V. Gant, Eds. Cambridge, U.K.: Cambridge Univ. Press, 2001, pp. 298-326.
23. J. G. Carney, P. Cunningham, and U. Bhagwan, "Confidence and prediction intervals for neural network ensembles," in Proc. Int. Joint Conf. Neural Netw., vol. 2. Washington D.C., Jul. 1999, pp. 1215-1218. (Pubitemid 30593029)
24. E. Zio, "A study of the bootstrap method for estimating the accuracy of artificial neural networks in predicting nuclear transient processes," IEEE Trans. Nucl. Sci., vol. 53, no. 3, pp. 1460-1478, Jun. 2006. (Pubitemid 44109454)
25. F. Giordano, M. La Rocca, and C. Perna, "Forecasting nonlinear time series with neural network sieve bootstrap," Comput. Stat. & Data Anal., vol. 51, no. 8, pp. 3871-3884, May 2007. (Pubitemid 46497476)
26. N. O. Oleng', A. Gribok, and J. Reifman, "Error bounds for data-driven models of dynamical systems," Comput. Biol. Med., vol. 37, no. 5, pp. 670-679, May 2007. (Pubitemid 46400622)
27. D. A. Nix and A. S. Weigend, "Estimating the mean and variance of the target probability distribution," in Proc. IEEE Int. Conf. Neural Netw. World Congr. Comput. Intell., vol. 1. Orlando, FL, Jun.-Jul. 1994, pp. 55-60.
28. I. Rivals and L. Personnaz, "Construction of confidence intervals for neural networks based on least squares estimation," Neural Netw., vol. 13, nos. 4-5, pp. 463-484, Jun. 2000. (Pubitemid 30447431)
29. G. Papadopoulos, P. J. Edwards, and A. F. Murray, "Confidence estimation methods for neural networks: A practical comparison," IEEE Trans. Neural Netw., vol. 12, no. 6, pp. 1278-1287, Nov. 2001. (Pubitemid 33106033)
30. P. J. M. van Laarhoven and E. H. L. Aarts, Simulated Annealing: Theory and Applications. Boston, MA: Kluwer, 1987.
31. E. Aarts and J. Korst, Simulated Annealing and Boltzmann Machines: A Stochastic Approach to Combinatorial Optimization and Neural Computing (Discrete Mathematics and Optimization). New York: Wiley, 1989.
32. S. Kirkpatrick, C. D. Gelatt, Jr., and M. P. Vecchi, "Optimization by simulated annealing," Science, vol. 220, no. 4598, pp. 671-680, May 1983.
33. S. Hashem, "Optimal linear combinations of neural networks," Neural Netw., vol. 10, no. 4, pp. 599-614, Jun. 1997. (Pubitemid 27357174)
34. L. Ma and K. Khorasani, "New training strategies for constructive neural networks with application to regression problems," Neural Netw., vol. 17, no. 4, pp. 589-609, May 2004. (Pubitemid 38510341)
35. A. Khosravi, S. Nahavandi, and D. Creighton, "Constructing prediction intervals for neural network metamodels of complex systems," in Proc. Int. Joint Conf. Neural Netw., Atlanta, GA, Jun. 2009, pp. 1576-1582.
36. P. Vlachos. (2010, Jan. 10). StatLib Datasets Archive [Online]. Available: http://lib.stat.cmu.edu/datasets
37. B. De Moor. (2010, Jan. 10). DaISy: Database for the Identification of Systems. Dept. Elect. Eng., ESAT/SISTA, Katholieke Univ. Leuven, Leuven, Belgium [Online]. Available: http://homes.esat.kuleuven.be/smc/daisy/