Reliability of statistical software

American Journal of Agricultural Economics

Volumn 92, Issue 5, 2010, Pages 1472-1489

  Odeh, Oluwarotimi O ^a   Featherstone, Allen M ^b   Bergtold, Jason S ^b  

^a VIRGINIA STATE UNIVERSITY   (United States)

^b KANSAS STATE UNIVERSITY   (United States)

Author keywords

accuracy; benchmarking; linear; nonlinear; reliability; statistical software

Indexed keywords

ACCURACY ASSESSMENT; BENCHMARKING; DATA SET; ECONOMETRICS; LEAST SQUARES METHOD; RELIABILITY ANALYSIS; SOFTWARE;

EID: 78650593265     PISSN: 00029092     EISSN: 14678276     Source Type: Journal    
DOI: 10.1093/ajae/aaq068     Document Type: Article

References (44)

1. Altman,M.,and M. P. McDonald. 2001. Choosing Reliable Statistical Software. Political Science and Politics 34: 681-687.
2. Altman, M., J. Gill, and M. P. McDonald. 2004. Numerical Issues in Statistical Computing for the Social Scientist. Hoboken, NJ: John Wiley & Sons.
3. Benichou, M., J. M. Gauthier, G. Hentges, and G. Ribiere. 1977. The Efficient Solution of Large-Scale Linear Programming Problems-Some Algorithmic Techniques and Computational Results. Mathematical Programming 13: 280-322.
4. Brown, B. W. 2003. DCDFLIB: Library of Routines for Cumulative Distribution Functions Inverses,and Other Parameters. Division of Quantitative Science, University ofTexasMDAnderson Cancer Center. http://biostatistics. mdanderson.org/SoftwareDownload/ SingleSoftware.aspx- Software-Id=21 (accessed June 2, 2010).
5. Crowder, H. P., R. S. Dembo, and J. M. Mulvey. 1978. Reporting Computational Experiments in Mathematical Programming. Mathematical Programming 15:316-329.
6. Davidson, R., and J. G. MacKinnon. 1993. Estimation and Inference in Econometrics. NewYork: Oxford University Press.
7. Dewald, W. G., T. G. Thursby, and R. G. Anderson. 1986. Replication in Empirical Economics: The Journal of Money, Credit and Banking Project. American Economic Review 76: 587-603.
8. Gay, D. 1990. Usage Summary for Selected Optimization Routines, Computing Science Technical Report No. 153. Murray Hill, NJ: AT&T Bell Laboratories. http://netlib.bell-labs.com/cm/cs/ cstr/153.pdf (accessed June 2, 2010).
9. Gill, P. E., W. Murray, and M. H. Wright. 1981. Practical Optimization. London: Academic Press.
10. Ibaraki, T. 1976. Theoretical Comparisons of Search Strategies in Branch-and Bound Algorithms. International Journal of Computer Information Science 5: 315-344.
11. Keeling, K. B., and R. J. Pavur. 2007. A Comparative Study of Nine Statistical Software Packages. Computational Statistics and Data Analysis 51: 3811-3831.
12. Knüsel, L. 1995. On the Accuracy of Statistical Distributions in GAUSS. Computational Statistics and Data Analysis 20: 699-702.
13. -. 1998. On the Accuracy of Statistical Distributions in Microsoft Excel 97. Computational Statistics and Data Analysis 26: 375-377.
14. - 2003. Computation of Statistical Distributions: Documentation of the Program ELV (2nd ed.). Department of Statistics, University of Munich. http:// www.stat.uni-muenchen.de/?knuesel/elv/ elv-docu.pdf (accessed June 2, 2010).
15. -. 2005. On the Accuracy of Statistical Distributions in Microsoft Excel 2003. Computational Statistics and DataAnalysis 48: 445-449.
16. Land,A. H.,and S. Powell. 1973. Fortran Codes for Mathematical Programming: Linear, Quadratic and Discrete. New York: John Wiley & Sons.
17. Leamer, E. E. 1983. Let's Take the Con out of Econometrics. American Economic Review 73: 31-43.
18. L'ecuyer, P., and Simard, R. 2007. TestU01: A C Library for Empirical Testing of Random Number Generators. ACM Transactions on Mathematical Software 33(4). http://portal.acm.org/citation.cfm- id=1268777 (accessed June 2, 2010).
19. McCullough, B. D. 1998. Assessing the Reliability of Statistical Software: Part I. American Statistician 52(4): 358-366.
20. -. 1999a. Assessing the Reliability of Statistical Software: Part II. American Statistician 53(2): 149-159.
21. -. 1999b. Econometric Software Reliability: EViews, LIMDEP, SHAZAM and TSP. Journal of Applied Econometrics 14(2): 191-202.
22. -. 2000. The Accuracy of Mathematica 4 as a Statistical Package. Computational Statistics 15: 279-299.
23. -. 2004. Wilkinson's Tests and Econometric Software. Journal of Economic and Social Measurement 29: 261-272.
24. -. 2006. A Review of TestU01. Journal of Applied Econometrics 21: 677-682.
25. McCullough, B. D., and D. A. Heiser. 2008. On the Accuracy of Statistical Procedures in Microsoft Excel 2007. Computational Statistics and Data Analysis 52: 4570-4578.
26. McCullough, B. D., and H. D. Vinod. 1999. The Numerical Reliability of Econometric Software. Journal of Economic Literature 37(2): 633-665.
27. McCullough, B. D., and B. Wilson. 1999. On the Accuracy of Statistical Procedures in Excel 97. Computational Statistics and Data Analysis 31(1): 27-37.
28. -. 2002. On the Accuracy of Statistical Procedures in Excel 2000. Computational Statistics and DataAnalysis 40(4): 713-721.
29. -. 2005. On the Accuracy of Statistical Procedures in Microsoft Excel 2003. Computational Statistics and Data Analysis 49: 1244-1252.
30. Murray,W. 1972. Failure, the Causes and Cures. In Numerical Methods for Unconstrained Optimization, ed.W. Murray, pp. 107-122. New York: Academic Press, .
31. National Institute of Standards and Technology. 2003. Statistical Reference Datasets. http://www.itl.nist.gov/div898/strd (accessed on March 2, 2010).
32. Nerlove, M. 2005. On the Numerical Accuracy of Mathmatica 5.0 for Doing Linear and Nonlinear Regression. Mathematica Journal 9(4): 824-851.
33. Rogers, J., Filliben, J., Gill, L., Guthrie, W., Lagergren, E., and Vangel, M. 1998. StRD: Statistical Reference Datasets for Assessing the Numerical Accuracy of Statistical Software. NISTTN# 1396, National Institute of Standards and Technology.
34. SAS Institute. 2003. Assessing the Numerical Accuracy of SAS Software, version 2. http://support.sas.com/rnd/app/papers/ statisticalaccuracy.pdf (accessed June 2, 2010).
35. Sawitzki, G. 1994. Numerical Reliability of Data Analysis Systems. Computational Statistics and DataAnalysis 18(2): 269-286.
36. Silk, J. 1996. System Estimation: A comparison of SAS, SHAZAM, and TSP. Journal of Applied Econometrics 11(4): 437-450.
37. Simon, S. D., and J. P. LeSage. 1988. Benchmarking Numerical Accuracy of Statistical Algorithms. Computational Statistics and Data Analysis 7:197-209.
38. Stata. 2007. NIST StRD Certification Results Using STATA 10. http://www. stata.com/support/cert/nist10/ (accessed June 2, 2010).
39. Tice, T. F., and M. G. Kletke. 1984. Reliability of Linear Programming Software: An Experience with the IBM Mathematical Programming System Series. American Journal of Agricultural Economics 66: 104-107.
40. Tomek, W. G. 1993. Confirmation and Replication in Empirical Econometrics:A Step Toward Improved Scholarship. American Journal of Agricultural Economics 75: 6-14.
41. Time Series Processor. 2010. Benchmarks. http://www.tspintl.com/products/ tsp/benchmarks/ index.htm (accessed June 2, 2010).
42. Vinod, H. D. 2000. Review ofGAUSS forWindows, Including Its Numerical Accuracy, Journal of Applied Econometrics 15(2): 211-220.
43. Yalta, A. T. 2007. The Numerical Reliability of GAUSS 8.0. The American Statistician 61: 262-268.
44. -. 2008.The Accuracy of Statistical Distributions in Microsoft® Excel 2007.Computational Statistics and Data Analysis 52: 4579-4586.