Variance analysis in software fault prediction models

Proceedings - International Symposium on Software Reliability Engineering, ISSRE

Volumn , Issue , 2009, Pages 99-108

  Jiang, Yue ^a   Lin, Jie ^a   Cukic, Bojan ^a   Menzies, Tim ^a  

^a West Virginia University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURATE PREDICTION; BEST PRACTICE; BINARY CLASSIFIERS; CLASSIFICATION PERFORMANCE; CROSS VALIDATION; CURRENT PROJECTS; DATA SETS; EMPIRICAL SOFTWARE ENGINEERING; FAULT DATA; FAULT PREDICTION; IMPACT MODEL; PREDICTION PERFORMANCE; RELIABILITY INDICATORS; SOFTWARE FAULT PREDICTION; SOFTWARE QUALITY ASSURANCE; SOFTWARE SUBSYSTEM; TRAINING SUBSETS; VARIANCE ANALYSIS; VERIFICATION AND VALIDATION;

CLASSIFICATION (OF INFORMATION); CLASSIFIERS; COMPUTER SOFTWARE SELECTION AND EVALUATION; FORECASTING; LEARNING ALGORITHMS; MATHEMATICAL MODELS; MODELS; NONLINEAR CONTROL SYSTEMS; SOFTWARE ENGINEERING; SOFTWARE RELIABILITY; SUPERVISED LEARNING; TOTAL QUALITY MANAGEMENT;

QUALITY ASSURANCE;

EID: 77951482577     PISSN: 10719458     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISSRE.2009.13     Document Type: Conference Paper

References (29)

1. Metric data program. NASA Independent Verification and Validation facility, Available from http://MDP.ivvnasa.gov.
2. C. Andersson and P. Runeson. A replicated quantitative analysis of fault distributions in complex software systems. IEEE Transaction of Software Engineering, 33(5):273-286, 2007.
3. E. Arisholm, L. C. Briand, and E. B. Johannessen. A systematic and comprehensive investigation of methods to build and evaluate fault prediction models. Simula Technical Report, TR-2008-06, 2008.
4. G. Boetticher, T. Menzies, and T. Ostrand. Promise repository of empirical software engineering data, 2007. available in url{http://promisedata. org/}.
5. L. Breiman. Random forests. Machine Learning, 45:5-32, 2001.
6. L. Breiman and P. Spector. Submodel selection and evaluation in regression: The x-random case. International Statistical Review, 60:291-319, 1992.
7. J. Demsar. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 7, 2006.
8. B. Efron and R. Tibshirani. Introduction to the bootstrap. Chapman and Hall, 1993.
9. N. E. Fenton and M. Neil. A critique of software defect prediction models. IEEE Transactions on Software Engineering, 25(5):675-689, 1999.
10. L. Guo, Y. Ma, B. Cukic, and H. Singh. Robust prediction of fault-proneness by random forests. In Proc. of the 15th International Symposium on Software Relaibility Engineering ISSRE'04, pages 417-428, 2004.
11. D. V. Huntsberger and P. Billingsley. Elements of Statistical Inference. Allyn and Bacon Inc., 1981.
12. A. Isaksson, M.Wallman, H. Goransson, and M. Gustafsson. Cross-validation and bootstrapping are unreliable in small sample classification. Pattern Recognition Letters, 29:1960- 1965, 2008.
13. Y. Jiang, B. Cukic, and Y. Ma. Techniques for evaluating fault prediction models. Empirical Software Engineering, 13(5):561-595, 2008.
14. Y. Jiang, B. Cukic, and T. Menzies. Fault prediction using early lifecycle data. In The 18th IEEE International Symposium on Software Reliability Engineering, pages 237-246, Nov. 2007.
15. Y. Jiang, B. Cukic, and T. Menzies. Cost curve evaluation of fault prediction models. In the 19th International Symposium on Software Reliability Engineering, pages 197-206, Nov. 2008.
16. Y. Jiang, B. Cukic, T. Menzies, and N. Bartlow. Comparing design and code metrics for software quality prediction. In Proceedings of the 4th international workshop on Predictor models in software engineering, pages 11-18, 2008.
17. T. M. Khoshgoftaar and E. B. Allen. Classification of faultprone software modules: Prior probabilities, costs, and model evaluation. Empirical Software Engineering, 3(3):275-298, 1998.
18. T. M. Khoshgoftaar, E. B. Allen, W. D. Jones, and J. P. Hudepohl. Cost-benefit analysis of software quality models. Software Quality Control, 9(1):9-30, 2001.
19. R. Kohavi. A study of cross-validation and bootstrap for accuracy estimation and model selection. In International Joint Conference on Artificial Intelligence (IJCAI), pages 1137- 1145, 1995.
20. S. Lessmann, B. Baesens, C. Mues, and S. Pietsch. Benchmarking classification models for software defect prediction: A proposed framework and novel findings. Software Engineering, IEEE Transactions on, 34(4):485-496, 2008.
21. Y. Ma. An Empirical Investigation of Tree Ensembles in Biometrics and Bioinformatics. PhD thesis, January 2007.
22. T. Menzies, J. Greenwald, and A. Frank. Data mining static code attributes to learn defect predictors. IEEE Transactions on Software Engineering, 33(1):2-13, January 2007.
23. N. Nagappan, B. Murphy, and V. Basili. The influence of organizational structure on software quality: an empirical case study. In ICSE '08: Proceedings of the 30th international conference on Software engineering, pages 521-530, 2008.
24. E. Parzen. On estimation of a probability density function and mode. Annual Statistics, 33(3):1065-1076, 1962.
25. M. Stone. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society B, 36(1):111-148, 1974.
26. B. Turhan and A. Bener. A multivariate analysis of static code attributes for defect prediction. In QSIC '07: Proceedings of the Seventh International Conference on Quality Software, pages 231-237, Washington, DC, USA, 2007.
27. S. Vanderlooy and E. Hullermeier. A critical analysis of variants of the auc. Machine Learning, 72:247-262, 2008.
28. I. H. Witten and E. Frank. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, 2005.
29. K. Wolter. Introduction to Variance Estimation. Springer Series in Statistics, 2007.