Estimating reliability for assessing and correcting individual streaming predictions

Reliable Knowledge Discovery

Volumn , Issue , 2012, Pages 29-49

  Rodrigues, Pedro Per Eira ^a   Bosnić, Zoran ^b   Gama, J ^a   Kononenko, Igor ^b  

^a UNIVERSITY OF PORTO   (Portugal)

^b UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS; KALMAN FILTERS; NEAREST NEIGHBOR SEARCH; REGRESSION ANALYSIS; RELIABILITY;

DECISION SUPPORTS; EMPIRICAL MEASURE; INDIVIDUAL PREDICTION; K-NEAREST NEIGHBORS; PREDICTIVE SYSTEMS; REAL-WORLD PROBLEM; RELIABILITY ESTIMATES; RELIABILITY ESTIMATION;

FORECASTING;

EID: 84908494183     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-1-4614-1903-7     Document Type: Chapter

References (27)

1. Asuncion, A., Newman, D.: UCI machine learning repository (2007). URL http://www.ics.uci.edu/$\sim$mlearn/{MLR}epository.html
2. Bosni, c, Z., Kononenko, I.: Comparison of approaches for estimating reliability of individual regression prediction. Data and Knowledge Engineering 67(3), 504-516 (2008)
3. Bosni, c, Z., Kononenko, I.: Estimation of individual prediction reliability using the local sensitivity analysis. Applied Intelligence 29(3), 187-203 (2008)
4. Bosni, c, Z., Kononenko, I.: An overview of advances in reliability estimation of individual predictions in machine learning. Intelligent Data Analysis 13(2) (2009)
5. Bosni, c, Z., Kononenko, I.: Correction of regression predictions using the secondary learner on the sensitivitiy analysis outputs. Computing and Informatics (in press) pp. 1-17 (2010)
6. Bousquet, O., Elisseeff, A.: Stability and generalization. Journal of Machine Learning Research 2, 499-526 (2002)
7. Breiman, L.: Bagging predictors. Machine Learning 24, 123-140 (1996)
8. Cormode, G., Muthukrishnan, S., Zhuang, W.: Conquering the divide: Continuous clustering of distributed data streams. In: Proceedings of the 23rd International Conference on Data Engineering (ICDE 2007), pp. 1036-1045 (2007)
9. Craven, M., Shavlik, J.W.: Understanding time-series networks: a case study in rule extraction. International Journal of Neural Systems 8(4), 373-384 (1997)
10. Drucker, H.: Improving regressors using boosting techniques. In: Machine Learning: Proceedings of the Fourteenth International Conference, pp. 107-115 (1997)
11. Gama, J., Medas, P., Castillo, G., Rodrigues, P.P.: Learning with drift detection. In: Proceedings of the 17th Brazilian Symposium on Artificial Intelligence (SBIA 2004), pp. 286-295. Springer Verlag, São Luiz, Maranhão, Brazil (2004)
12. Gama, J., Rodrigues, P.P.: Data stream processing. In: Learning from Data Streams-Processing Techniques in Sensor Networks, chap. 3, pp. 25-39. Springer Verlag (2007)
13. Gama, J., Rodrigues, P.P., Lopes, L.: Clustering distributed sensor data streams using local processing and reduced communication. Intelligent Data Analysis 15(1), 3-28 (2011)
14. Gama, J., Sebastião, R., Rodrigues, P.P.: Issues in evaluation of stream learning algorithms. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2009), pp. 329-337. ACM Press, Paris, France (2009)
15. Geurts, P.: Dual perturb and combine algorithm. In: Proc. of the Eighth International Workshop on Artificial Intelligence and Statistics, AI+STATS2001, pp. 196-201. Florida (2001)
16. Hulten, G., Spencer, L., Domingos, P.: Mining time-changing data streams. In: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 97-106. ACM Press (2001)
17. Kalman, R.E.: A new approach to linear filtering and prediction problems. Transaction of ASME-Journal of Basic Engineering pp. 35-45 (1960)
18. Kendall, M.: A new measure of rank correlation. Biometrika 30, 81-89 (1938)
19. Khotanzad, A., Afkhami-Rohani, R., Lu, T.L., Abaye, A., Davis, M., Maratukulam, D.J.: Annstlf-a neural-network-based electric load forecasting system. IEEE Transactions on Neural Networks 8(4), 835-846 (1997)
20. Kukar, M., Kononenko, I.: Reliable classifications with machine learning. In: Proceedings of the 13Theuropean Conference on Machine Learning, pp. 219-231. Springer Verlag (2002)
21. Nash, W.J., Sellers, T.L., Talbot, S.R., Cawthorn, A.J., Ford, W.B.: The population biology of abalone (haliotis species) in tasmania. i. blacklip abalone (h. rubra) from the north coast and islands of bass strait. Tech. Rep. 48, Sea Fisheries Division (1994)
22. Oza, N.C., Russell, S.J.: Experimental comparisons of online and batch versions of bagging and boosting. In: Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 359-364 (2001)
23. Rodrigues, P.P., Gama, J.: A system for analysis and prediction of electricity load streams. Intelligent Data Analysis 13(3), 477-496 (2009)
24. Rodrigues, P.P., Gama, J., Bosni, c, Z.: Online reliability estimates for individual predictions in data streams. In: ICDM Workshops, pp. 36-45. IEEE (2008)
25. Rodrigues, P.P., Gama, J., Pedroso, J.P.: Hierarchical clustering of time-series data streams. IEEE Transactions on Knowledge and Data Engineering 20(5), 615-627 (2008)
26. Rodrigues, P.P., Gama, J., Sebastião, R.: Memoryless fading windows in ubiquitous settings. In: Proceedings of the Ubiquitous Data MiningWorkshop, pp. 23-27. Lisboa, Portugal (2010)
27. Shafer, G., Vovk, V.: A tutorial on conformal prediction. Journal of Machine Learning Research 9, 371-421 (2008)