Learning better inspection optimization policies

International Journal of Software Engineering and Knowledge Engineering

Volumn 22, Issue 5, 2012, Pages 621-644

  Lumpe, Markus ^a   Vasa, Rajesh ^a   Menzies, Tim ^b   Rush, Rebecca ^b   Turhan, Burak ^c  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b WEST VIRGINIA UNIVERSITY   (United States)

^c UNIVERSITY OF OULU   (Finland)

Author keywords

Data mining; defect prediction; static measures

Indexed keywords

DEFECT PREDICTION; INSPECTION OPTIMIZATION; JAVA SYSTEM; LINES OF CODE; OPEN-SOURCE; SOFTWARE SYSTEMS; STATIC CODES; STATIC MEASURES; UPPER BOUND;

DATA MINING; FORECASTING; INSPECTION; OPTIMIZATION;

DEFECTS;

EID: 84867853228     PISSN: 02181940     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218194012500179     Document Type: Article

References (69)

1. C. Bird, N. Nagappan, H. Gall, B. Murphy and P. Devanbu, Putting it all together: Using socio-technical networks to predict failures, in Proceedings of 20th International Symposium on Software Reliability Engineering, Nov. 2009, pp. 109-119.
2. C. Bird, N. Nagappan, P. Devanbu, H. Gall and B. Murphy, Does distributed development affect software quality? An empirical case study of Windows Vista, in Proceedings of 31st International Conference on Software Engineering, May 2009, pp. 518-528.
3. N. Nagappan, B. Murphy, and V. Basili, The influence of organizational structure on software quality: An empirical case study, in Proceedings of the 30th International Conference on Software Engineering, May 2008, pp. 521-530.
4. P. J. Guo, T. Zimmermann, N. Nagappan and M. Brendan, Characterizing and predicting which bugs get fixed: An empirical study of microsoft windows, in Proceedings of the 32nd International Conference on Software Engineering, May 2010, pp. 495-504.
5. R. Vasa, M. Lumpe and A. Jones, Helix-Software Evolution Data Set, http://www. ict.swin.edu.au/research/projects/helix, December 2010.
6. R. Vasa, Growth and Change Dynamics in Open Source Software Systems, Ph.D. dissertation, Swinburne University of Technology, Faculty of Information and Communication Technologies, October 2010.
7. R. Vasa, M. Lumpe, P. Branch and O. Nierstrasz, Comparative analysis of evolving software systems using the Gini coeficient, in Proceedings of 25th IEEE International Conference on Software Maintenance, Edmonton, Alberta, IEEE Computer Society, September 2009, pp. 179-188.
8. M. Lumpe, S. Mahmud and R. Vasa, On the use of properties in Java applications, in Proceedings of the 21st Australian Software Engineering Conference, Auckland, New Zealand, April 2010, pp. 235-244.
9. B. Boehm and P. Papaccio, Understanding and controlling software costs, IEEE Trans. Software Engineering 14(10) (1988) 1462-1477.
10. F. Shull, V. R. Basili, B. Boehm, A. W. Brown, P. Costa, M. Lindvall, D. Port, I. Rus, R. Tesoriero and M. V. Zelkowitz, What we have learned about fighting defects, in Proceedings of 8th International Software Metrics Symposium, Ottawa, Canada, 2002.
11. J. D. Arthur, M. K. Groner, K. J. Hayhurst and C. M. Holloway, Evaluating the effectiveness of independent verification and validation, IEEE Computer, October 1999.
12. J. B. Dabney, G. Barber and D. Ohi, Predicting software defect function point ratios using a bayesian belief network, in Proceedings of the PROMISE Workshop, 2006.
13. N. Nagappan and T. Ball, Use of relative code churn measures to predict system defect density, in ICSE'05, 2005, pp. 284-292.
14. S. R. Chidamber and C. F. Kemerer, A metrics suite for object oriented design, IEEE Trans. Software Engineering 20(6) (1994) 476-493.
15. T. Menzies, J. Greenwald and A. Frank, Data mining static code attributes to learn defect predictors, IEEE Trans. Software Engineering 33(1) (2007) 2-13. (Pubitemid 46002165)
16. N. Nagappan and T. Ball, Static analysis tools as early indicators of pre-release defect density, in Proceedings of the 27th International Conference on Software Engineering, May 2005, pp. 580-586.
17. J. Turner, A predictive approach to eliminating errors in software code, 2006, available from http://www.sti.nasa.gov/tto/Spinoff2006/ct1.html.
18. A. Tosun, B. Turhan and A. Bener, Practical considerations of deploying AI in defect prediction: A case study within the Turkish telecommunication industry, in Proceedings of the 5th International Conference on Predictor Models in Software Engineering, May 2009, pp. 1-9.
19. A. Tosun, A. Bener and R. Kale, AI-based software defect predictors: Applications and benefits in a case study, in Twenty-Second IAAI Conference on Artificial Intelligence, July 2010, pp. 1748-1755.
20. E. Arisholm and L. Briand, Predicting fault-prone components in a Java legacy system, in Proceedings of the 5th ACM/IEEE International Symposium on Empirical Software Engineering, September 2006, pp. 8-17. (Pubitemid 46634436)
21. A. Koru, D. Zhang, K. El Emam and H. Liu, An investigation into the functional form of the size-defect relationship for software modules, IEEE Trans. Software Engineering 35(2) (2009) 293-304.
22. A. Koru, K. E. Emam, D. Zhang, H. Liu and D. Mathew, Theory of relative defect proneness: Replicated studies on the functional form of the size-defect relationship, Empirical Software Engineering, October 2008, pp. 473-498.
23. A. Koru, D. Zhang and H. Liu, Modeling the effect of size on defect proneness for open-source software, in International Workshop on Predictor Models in Software Engineering (PROMISE'07), May 2007, Article No. 10.
24. G. Boetticher, T. Menzies and T. Ostrand, The PROMISE Repository of Empirical Software Engineering Data, 2007, http://promisedata.org/.
25. M. Jureczko and D. Spinellis, Using object-oriented design metrics to predict software defects, Models and Methods of System Dependability, Oficyna Wydawnicza Politechniki Wroc awskiej, 2010, pp. 69-81.
26. J. Krinke, Identifying similar code with program dependence graphs, in Proceedings of the Eighth Working Conference on Reverse Engineering (WCRE'01), IEEE Computer Society, October 2001, pp. 301-309. (Pubitemid 33013360)
27. G. Antoniol, G. Canfora, G. Casazza and A. De Lucia, Information retrieval models for recovering traceability links between code and documentation, in Proceedings of the International Conference on Software Maintenance (ICSM'00), 2000, pp. 40-49. (Pubitemid 32072782)
28. K. Kontogiannis, R. DeMori, E. Merlo, M. Galler and M. Bernstein, Pattern matching for clone and concept detection, Journal of Automated Software Engineering 3 (1996) 77-108. (Pubitemid 126820491)
29. J. H. Johnson, Substring matching for clone detection and change tracking, in Proceedings of the International Conference on Software Maintenance (ICSM 94), 1994, pp. 120-126.
30. I. H. Witten and E. Frank, Data Mining, 2nd edn. (Morgan Kaufmann, Los Altos, 2005).
31. T. McCabe, A complexity measure, IEEE Trans. Software Engineering 2(4) (1976) 308-320.
32. S. Lessmann, B. Baesens, C. Mues and S. Pietsch, Bench-marking classification models for software defect prediction: A proposed framework and novel findings, IEEE Trans. Software Engineering 34(4) (2008) 485-496.
33. T. M. Khoshgoftaar, N. Seliya and K. Gao, Assessment of a new three-group software quality classification technique: An empirical case study, Empirical Software Engineering 10 (2005) 183-218. (Pubitemid 40536264)
34. T. M. Khoshgoftaar, S. Zhong and V. Joshi, Enhancing software quality estimation using ensemble-classifier based noise filtering, Intell. Data Anal. 9 (2005) 3-27.
35. T. M. Khoshgoftaar, X. Yuan and E. B. Allen, Balancing misclassification rates in classification-tree models of software quality, Empirical Software Engineering 5 (2000) 313-330. (Pubitemid 32134486)
36. R. Harrison, S. Counsell and R. Nithi, An investigation into the applicability and validity of object-oriented design metrics, Empirical Software Engineering 3(3) (1998) 255-273.
37. L. C. Briand, S. Morasca and V. R. Basili, Defining and validating measures for object-based high-level design, IEEE Transactions on Software Engineering 25(5) (1999) 722-743. (Pubitemid 30541835)
38. L. Briand, J. Wiist, J. Daly and D. Victor Porter, Exploring the relationships between design measures and software quality in object-oriented systems, Journal of Systems and Software 51(3) (2000) 245-273.
39. N. Nagappan, T. Ball and A. Zeller, Mining metrics to predict component failures, in Proceedings of the 28th International Conference on Software Engineering, ACM, May 2006, pp. 452-461. (Pubitemid 46600942)
40. B. Turhan, T. Menzies, A. Bener and J. Di Stefano, On the relative value of cross-company and within-company data for defect prediction, Empirical Software Engineering 14(5) (2009) 540-578.
41. T. Menzies, O. Jalali, J. Hihn, D. Baker and K. Lum, Stable rankings for different effort models, Automated Software Engineering 17(4) (2010) 409-437.
42. R. Holte, Very simple classification rules perform well on most commonly used datasets, Machine Learning 11 (1993) 63-90.
43. V. R. Basili, L. C. Briand and W. L. Melo, A validation of object-oriented design metrics as quality indicators, IEEE Trans. Software Engineering 22(10) (1996) 751-761. (Pubitemid 126771690)
44. L. C. Briand, J. Wiist, S. V. Ikonomovski and H. Lounis, Investigating quality factors in object-oriented designs: An industrial case study, in Proceedings of 21st International Conference of Software Engineering, May 1999, pp. 345-354.
45. M. Cartwright and M. Shepperd, An empirical investigation fan object-oriented software system, IEEE Trans. Software Engineering 26 (2000) 786-796.
46. K. El Emam, S. Benlarbi, N. Goel and S. N. Rai, The confounding effect of class size on the validity of object-oriented metrics, IEEE Trans. Software Engineering 27(7) (2001) 630-650. (Pubitemid 32676815)
47. K. K. Aggarwal, Y. Singh, A. Kaur and R. Malhotra, Empirical analysis for investigating the effect of object-oriented metrics on fault proneness: A replicated case study, Software Process: Improvement and Practice 14(1) (2009) 39-62.
48. L. C. Briand and J. Wiist, Empirical studies of quality models in object-oriented systems, Advances in Computers 56 (2002) 98-167.
49. K. E. Emam, W. Melo and J. C. Machado, The prediction of faulty classes using object-oriented design metrics, System and Software 56 (2001) 63-75. (Pubitemid 33649526)
50. L. C. Briand, W. L. Melo and J. Wiist, Assessing the applicability of fault-proneness models across object-oriented software projects, IEEE Transactions on Software Engineering 28(7) (2002) 706-720.
51. K. K. Aggarwal, Y. Singh, A. Kaur and R. Malhotra, Investigating the effect of coupling metrics on fault proneness in object-oriented systems, Software Quality Professional 8(4) (2006) 4-16.
52. Investigating effect of design metrics on fault proneness in object-oriented sys tems, Journal of Object Technology 6(10) (2007) 127-141.
53. B. Turhan, G. Kocak and A. Bener, Software defect prediction using call graph based ranking (CGBR) framework, in Proceedings of 34th Euromicro Conference on Software Engineering and Advanced Applications, September 2008, pp. 191-198.
54. S. Brin and L. Page, The anatomy of a large-scale hypertextual Web search engine, in Proceedings of the 7th International Conference on World Wide Web, April 1998, pp. 107-117.
55. T. Zimmermann and N. Nagappan, Predicting defects using network analysis on dependency graphs, in Proceedings of the 30th International Conference on Software Engineering, (ICSE'08), New York, NY, USA, 2008, pp. 531-540.
56. S. Kpodjedo, F. Ricca, G. Antoniol and P. Galinier, Evolution and search based metrics to improve defects prediction, International Symposium on Search Based Software Engineering, 2009, pp. 23-32.
57. A. Miller, Subset Selection in Regression, 2nd edn. (Chapman & Hall, 2002).
58. S. Wagner, Global sensitivity analysis of predictor models in software engineering, in International Workshop on Predictor Models in Software Engineering (PROMISE'07), May 2007, Article No. 3.
59. I. Guyon, A. Elisseefi and L. Kaelbling, An introduction to variable and feature selection, Journal of Machine Learning Research 3(7&8) (2003) 1157-1182.
60. T. J. Ostrand, E. J. Weyuker and R. M. Bell, Where the bugs are, in Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, New York, NY, USA, July 2004, pp. 86-96. (Pubitemid 41121380)
61. E. Weyuker, T. Ostrand and R. Bell, Do too many cooks spoil the broth? Using the number of developers to enhance defect prediction models, Empirical Software Engineering 13(5) (2008) 539-559.
62. H. Zhang and X. Zhang, Comments on data mining static code attributes to learn defect predictors, IEEE Trans. Software Engineering 33(9) (2007) 635-637.
63. T. Menzies, A. Dekhtyar, J. Distefano and J. Greenwald, Problems with precision: A response to comments on data mining static code attributes to learn defect predictors, IEEE Trans. Software Engineering 33(9) (2007) 637-640. (Pubitemid 47322970)
64. K. Sunghun, T. Zimmermann, E. J. Whitehead Jr. and A. Zeller, Predicting faults from cached history, in Proceedings of the 29th International Conference on Software Engineering (ICSE'07), Washington, DC, USA, 2007, pp. 489-498. (Pubitemid 47430683)
65. F. Rahman, D. Posnett, A. Hindle, E. Barr and P. Devanbu, BugCache for inspections: Hit or miss? in Proceedings of the 19th ACM SIGSOFT Symposium and 13th European Conference on Foundations of Software Engineering (ESEC/FSE'11), Szeged, Hungary, September 2011, pp. 322-331.
66. W. Li and S. Henry, Object-oriented metrics that predict maintainability, Journal of Systems and Software 23(2) (1993) 111-122.
67. P. Cohen, Empirical Methods for Artificial Intelligence (MIT Press, 1995).
68. M. Lumpe, L. Grunske and J.-G. Schneider, State space reduction techniques for component interfaces, in Proceedings of 11th International Symposium on Component-Based Software Engineering (CBSE 2008), October 2008, pp. 130-145.
69. M. Lumpe and R. Vasa, Partition refinement of component interaction automata: Why structure matters more than size, Electronic Proceedings in Theoretical Computer Science 37 (2010) 12-26.