A comparative study of the reliability of nine statistical software packages

Computational Statistics and Data Analysis

Volumn 51, Issue 8, 2007, Pages 3811-3831

  Keeling, Kellie B ^a   Pavur, Robert J ^b  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b UNIVERSITY OF NORTH TEXAS   (United States)

Author keywords

Numerical accuracy; Software testing; Statistical reference data sets (StRD)

Indexed keywords

ANALYSIS OF VARIANCE (ANOVA); LINEAR REGRESSION; NUMERICAL METHODS; PRINCIPAL COMPONENT ANALYSIS; RELIABILITY THEORY; STATISTICAL METHODS;

NUMERICAL ACCURACY; STATISTICAL REFERENCE DATA SETS (STRD); STATISTICAL SOFTWARE PACKAGES;

SOFTWARE PACKAGES;

EID: 34047135493     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2006.02.013     Document Type: Article

References (25)

1. Altman M., and McDonald M. Choosing reliable statistical software. PS: Political Sci. Politics 43 3 (2001) 681-687
2. Altman M., Gill J., and McDonald M. Numerical Issues in Statistical Computing for the Social Scientist (2004), Wiley, New York
3. Cleveland W.S. Visualizing Data (1993), Hobart Press
4. Creighton, L., Ding, J. 2004. White paper on JMP's web site. Assessing the numerical accuracy of JMP. 〈http://www.jmp.com/software/whitepapers〉.
5. Cryer J. Problems with using Microsoft Excel for statistics. Proceedings of the 2001 Joint Statistical Meetings (2001), American Statistical Association, Alexandria, VA
6. Dielman T. Comment on McCullough, B.D., 1999. Letters to the editor. Amer. Statist. 55 4 (2001) 373
7. Dielman T. The numerical accuracy of statistical calculations in Excel 2000 and Minitab Version 13. J. Bus. Manage. 8 2 (2002) 199-207
8. Fylstra D., Lasdon L., Watson J., and Waren A. Design and use of the Microsoft Excel solver. Interfaces 28 5 (1998) 29-55
9. Kitchen A.M., Drachenberg R., and Symanzik J. Assessing the reliability of web-based statistical software. Comput. Statist. 1 (2003) 107-122
10. Knusel L. On the accuracy of statistical distributions in Microsoft Excel 2003. Comput. Statist. Data Anal. 48 3 (2005) 445-449
11. L'Ecuyer, P., Simard, R., 2004. TestU01: a software library in ANSI C for empirical testing of random number generators. Software user's guide can be downloaded at 〈http://www.iro.umontreal.ca/∼lecuyer/〉.
12. McCullough B.D. Assessing the reliability of statistical software: part I. Amer. Statist. 52 (1998) 358-366
13. McCullough B.D. Assessing the reliability of statistical software: part II. Amer. Statist. 53 (1999) 149-159
14. McCullough B.D. Econometric software reliability: E-views, LIMDEP, SHAZAM, and TSP. J. Appl. Econ. 14 2 (1999) 191-202
15. McCullough B.D. Is it safe to assume that software is accurate?. Int. J. Forecast. 16 (2000) 349-357
16. McCullough B.D. Experience with the StRD: application and interpretation. Comput. Sci. Statist. 31 (2000) 16-21
17. McCullough B.D. The accuracy of Mathematica 4 as a statistical package. Comput. Statist. 15 2 (2000) 279-299
18. McCullough B.D. Wilkinson's tests and econometric software. J. Econ. Soc. Meas. 29 (2004) 261-270
19. McCullough, B.D., 2006. A review of TESTU01. J. Appl. Econ., to appear.
20. McCullough B.D., and Wilson B. On the accuracy of statistical procedures in Microsoft Excel 2000 and Excel XP. Comput. Statist. Data Anal. 40 (2002) 713-721
21. McCullough B.D., and Wilson B. On the accuracy of statistical procedures in Microsoft Excel 2003. Comput. Statist. Data Anal. 49 4 (2005) 1244-1252
22. Rohrer, M., 2000. Seeing is believing: the importance of visualization in manufacturing simulation. Proceedings of 2000 Winter Simulation Conference, pp. 1211-1216.
23. Sawitzki G. Report on the reliability of data analysis systems. Comput. Statist. Data Anal. 18 (1994) 289-301
24. Tufte E. The Visual Display of Quantitative Information. second ed (2001), Graphics Press, Cheshire, CT
25. Wilkinson L. Statistics Quiz: Problems Which Reveal Deficiencies in Statistical Programs (1985), Systat Inc., Evanston, IL