Handling missing data in software effort prediction with naive Bayes and em algorithm

ACM International Conference Proceeding Series

Volumn , Issue , 2011, Pages

  Zhang, Wen ^a   Yang, Ye ^a   Wang, Qing ^a  

^a INSTITUTE OF SOFTWARE   (China)

Author keywords

EM algorithm; Missing data; Naive bayes

Indexed keywords

DATA SETS; EFFORT PREDICTION; EM ALGORITHMS; EXPECTATION MAXIMIZATION; GAUSSIAN COMPONENTS; IMPUTATION STRATEGY; IMPUTATION TECHNIQUES; MISSING DATA; MISSING DATA TOLERATION; MISSING VALUES; NAIVE BAYES; OPTIMAL LEVEL; PREDICTION MODEL; SOFTWARE EFFORT; SOFTWARE EFFORT PREDICTION; TRAINING DATA; UNLABELED DATA;

ALGORITHMS; DATA HANDLING; EMBEDDED SOFTWARE; EXPERIMENTS; FORECASTING; MATHEMATICAL MODELS; MODELS; PREDICTIVE CONTROL SYSTEMS; SOFTWARE ENGINEERING;

DATA MINING;

EID: 80054089117     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2020390.2020394     Document Type: Conference Paper

References (30)

1. T. W. Anderson. Maximum likelihood estimates for multivariate normal distribution when some observations are missing. Journal of American Statistical Association, 52:200-203, 1957.
2. A. Andersson, P. Davidsson, and J. Linden. Measure-based classifition performance evaluation. Pattern Recognition Letters, 20(12):1165-1173.
3. J. Arbucle. Full information estimation in presence of incomplete data. In G.A. Marcoulides and R.E. Schumacker, (eds.) Advanced Structural Equation Modeling, Issues and Techniques, 1996.
4. F. Cozman, I. Cohen, and M. Cirelo. Semi-supervised learning of mixture models. In Proceedings of the Twentieth International Conference on Machine Learning, pages 99-106, 2003.
5. E. Fix and J. L. Hodges. Discriminatory analysis - nonparametric discrimination: small sample performance. Technical Report Project 21-49-004 (4), USAF School of Aviation Medicine, Randolph Field, Texas, 1951.
6. G. Gan, C. Ma, , and J. Wu. Data Clustering Theory, Algorithms, and Applications. SIAM, Society for Industrial and Applied Mathematics, Philadelphia, 2007.
7. M. He, M. Li, Q. Wang, Y. Yang, and K. Ye. An investigation of software development productivity in china. In Proceedings of International Conference on Software Process, pages 381-394, 2008.
8. J. V. Hulse and T. M. Khoshgoftaar. A comprehensive empirical evaluation of missing value imputation in noisy software measurement data. The Journal of Systems and Software, 81:691-708.
9. T. M. Khoshgoftaar and J. V. Hulse. Imputation techniques for multivariate missingness in software measurement data. Software Quality Journal, 16(4):563-600, 2008.
10. T. M. Khoshgoftaar and J. V. Hulse. Software quality estimation with limited fault data: a semi-supervised learning perspective. Software Quality Journal, 16(4):563-600, 2008.
11. Y. Kodratoff and R. Michalski. Machine Learning, An Artificial Intelligence Approach. Morgan Kauffmann, San Fransisco, California, 1990.
12. R. Little and D. Rubin. Statistical Analysis with Missing Data. Wiley, New York, 1987.
13. E. Mendes and N. Mosley. Bayesian network models for web effort prediction: A comparative study. IEEE Transactions on Software Engineering, 34(6):723-736.
14. T. P. Minka. Expectation-maximization as lower bound maximization. http://research.microsoft.com/en-us/um/people/minka/papers/em.html, November1999.
15. A. Mockus. Missing data in software engineering. In F. Shull et al. (eds.), Guide to Advanced Empirical Software Engineering, pages 185-200, 2008.
16. I. Myrtveit, E. Stensrud, and U. H. Olsson. Analyzing data sets with missing data: An empirical evaluation of imputation methods and likelihood-based methods. IEEE Transactions on Software Engineering, 27(11):999-1013, 2001.
17. K. Nigam, A. Mccallum, and T. Mitchell. Text classification from labeled and unlabeled documents using em. Machine Learning, 39(2):103-134, 2000.
18. H. Park and S. Baek. An empirical validation of a neural network model for software effort estimation. Expert Systems with Applications, 35:929-937, 2008.
19. P. C. Pendharkar, G. H. Subramanian, and J. A. Rodger. A probabilistic model for predicting software development effort. IEEE Transactions on Software Engineering, 31(7):615-624.
20. J. Quinlan. Induction of decision trees. Machine Learning, 1(1):81-106, 1986.
21. J. Quinlan. Programs for Machine Learning. Morgan Kaufmann Publishers, Burlington, Massachusetts, 1993.
22. J. L. Schafer and J. Graham. Missing data: Our view of the state of the art. Psychological Methods, 7(2):147-177, 2002.
23. N. Seliya and T. M. Khoshgoftaar. Software quality estimation with limited fault data: a semi-supervised learning perspective. Software Quality Journal, 15(3):327-344, 2007.
24. P. Sentas and L. Angelis. Categorical missing data imputation for software cost estimation by multinominal logistic regression. The Journal of Systems and Software, 79(3):404-414, 2006.
25. Q. Song and M. Shepperd. A new imputation method for small software project data sets. The Journal of Systems and Software, 80:51-62, 2007.
26. Q. Song and M. Shepperd. Can k-nn imputation improve the performance of c4.5 with small software project data sets? a comparative evaluation. The Journal of Systems and Software, 81:2361-2370, 2008.
27. K. Strike, K. E. Emam, and N. Madhavji. Software cost estimation with incomplete data. IEEE Transactions on Software Engineering, 27(10):890-908, 2001.
28. D. Zhang and J.J.P.Tsai. Machine learning and software engineering. Software Quality Journal, 11:87-119, 2003.
29. W. Zhang, Y. Yang, and W. Q. Absent features or missing values. In Proceedings of International Conference on Software Engineering and Knowledge Engineering, pages 1-6, 2010.
30. W. Zhang, Y. Yang, and Q. Wang. On the predicability of software effort using machine learning techniques. In Proceedings of International Conference on Evaluation of Novel Approaches to Software Engineering, pages 1-8, 2011.