StatREC: A graphical user interface tool for visual hypothesis testing of cost prediction models

ACM International Conference Proceeding Series

Volumn , Issue , 2012, Pages 39-48

  Mittas, Nikolaos ^a   Mamalikidis, Ioannis ^b   Angelis, Lefteris ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^b Department of Electrical Engineering   (Greece)

Author keywords

Graphical comparison; Graphical user interface; Permutation test; Prediction models; REC curves; Software cost estimation

Indexed keywords

GRAPHICAL COMPARISON; PERMUTATION TESTS; PREDICTION MODEL; REC CURVES; SOFTWARE COST ESTIMATIONS;

COST ESTIMATING; GRAPHICAL USER INTERFACES; MATHEMATICAL MODELS; SOFTWARE TESTING;

SOFTWARE ENGINEERING;

EID: 84867711649     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2365324.2365331     Document Type: Conference Paper

References (23)

1. Shepperd, M. 2007. Software project economics: A roadmap. In Proceedings of the IEEE International Conference on Future of Software Engineering (FOSE '07), 304-315.
2. Jorgensen, M., and Shepperd, M. 2007. A systematic review of software development cost estimation studies. IEEE Trans Softw Eng 33 (1), 33-53.
3. Menzies, T., and Shepperd, M. 2012. Special issue on repeatable results in software engineering prediction. Emp Softw Eng 17 (1-2), 1-17.
4. Shepperd, M., and Kadoda, G. 2001. Comparing software prediction techniques using simulation. IEEE Trans Softw Eng 27 (11), 1014-1022.
5. Kitchenham, B., Pickard, L., MacDonell, S., and Shepperd, M. 2001. What accuracy statistics really measure. IEE Proc. Softw 148 (3), 81-85.
6. Foss, T., Stensrud, E., Kitchenham, B., and Myrtveit, I. 2003. A simulation study of the model evaluation criterion MMRE. IEEE Trans Softw Eng 29 (11), 985-995.
7. Stensrud, E., and Myrtveit, I. 1998. Human performance estimating with analogy and regression models: An empirical validation. In Proceedings of the IEEE 5th International Software Metrics Symposium (Metrics'98), 205-213.
8. Kitchenham, B., and Mendes, E. 2009. Why comparative effort prediction studies may be invalid. In Proceedings of the ACM 5th International Conference on Predictor Models in Software Engineering (PROMISE'09), 1-5.
9. Mittas, N., and Angelis, L. 2008. Comparing cost prediction models by resampling techniques. J Syst Softw 81 (5), 616-632.
10. Mittas, N., and Angelis, L. 2010. Visual comparison of software cost estimation models by regression error characteristic analysis. J Syst Softw 83, 621-637.
11. Mittas, N., and Angelis, L. 2012. A permutation test based on regression error characteristic curves for software cost estimation models. Emp Softw Eng 17 (1-2), 34-61.
12. R Development Core Team 2011. R: A language and environment for statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, http://www.Rproject.org.
13. Visual Basic.NET, Microsoft Visual Studio. http://www.microsoft.com/ visualstudio/en-us.
14. Baier, T., and Neuwirth, E. 2007. Excel :: COM :: R. Computational Statistics 22 (1), Physica Verlag.
15. Bi, J., and Bennet, K. 2003. Regression error characteristics curves. In Proceedings of the AIII 20th International Conference on Machine Learning (ICML'03), 43-50.
16. Egan, J. 1975. Signal Detection Theory and ROC Analysis. Series in Cognition and Perception. Academic Press.
17. Good, I. 2000. Permutation tests: a practical guide to resampling methods for testing hypotheses. Springer Series in Statistics 2nd edition.
18. Sheskin, D. 2004. Handbook of parametric and nonparametric statistical procedures, third ed. Chapman & Hall/CRC.
19. http://rcom.univie.ac.at/download.html.
20. Statistics and Information Research Group (STAINS) http://stains.csd. auth.gr/?page-id=34.
21. ISBSG dataset 10 (2007) http://www.isbsg.org.
22. Liebchen, G., and Shepperd, M. 2008. Data sets and data quality in software engineering. In Proceedings of the 4th ACM International Workshop on Predictor Models in Software Engineering, 39-44.
23. Keung, J. 2008. Empirical evaluation of analogy-X for software cost estimation. In Proceedings of the 2nd ACMIEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '08), 294-296.