Too big to fail: Large samples and the p-value problem

Information Systems Research

Volumn 24, Issue 4, 2013, Pages 906-917

  Lin, Mingfeng ^a   Lucas, Henry C ^b   Shmueli, Galit ^c  

^a UNIVERSITY OF ARIZONA   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c INDIAN SCHOOL OF BUSINESS   (India)

Author keywords

Effect size; Empirical modeling; Inference; P value; Practical significance; Statistical significance

Indexed keywords

HARDWARE; INFORMATION SYSTEMS;

EFFECT SIZE; EMPIRICAL MODEL; INFERENCE; P-VALUES; PRACTICAL SIGNIFICANCE; STATISTICAL SIGNIFICANCE;

STATISTICAL METHODS;

EID: 84891788717     PISSN: 10477047     EISSN: 15265536     Source Type: Journal    
DOI: 10.1287/isre.2013.0480     Document Type: Article

References (45)

1. Asvanund A, Clay K, Krishnan R, Smith MD (2004) An empirical analysis of network externalities in peer-to-peer music-sharing networks. Inform. Systems Res. 15:155-174.
2. Black SE, Strahan PE (2002) Entrepreneurship and bank credit availability. J. Finance 57(6):2807-2833.
3. Boh FW, Slaughter SA, Espinosa, JA (2007) Learning from experience in software development: A multilevel analysis. Management Sci. 53(8):1315-1331.
4. Brynjolfsson E, Hu YJ, Rahman MS (2009) Battle of the retail channels: How product selection and geography drive crosschannel competition. Management Sci. 55(11):1755-1765.
5. Buis ML (2007) Stata tip 53: Where did my p-values go? Stata Journal 7(4):584-586.
6. Cannon E, Cipriani GP (2006) Euro-illusion: A natural experiment. J. Money Credit Banking 38(5):1391-1403.
7. Carver RP (1978) The case against statistical significance testing. Harvard Educational Rev. 48(3):378-399.
8. Chatfield C (1995) Problem Solving: A Statistician's Guide, 2nd ed. (Chapman & Hall/CRC).
9. Cohen J (1990) Things I have learned (so far). Amer. Psychologist 45(12):1304-1312.
10. de Leeuw F (1971) The demand for housing: A review of crosssection evidence. Rev. Econom. Statist. 53(1):1-10.
11. Dellarocas C, Wood CA (2008) The sound of silence in online feedback: Estimating trading risks in the presence of reporting bias. Management Sci. 54(3):460-476.
12. Disdier A, Head K (2008) The puzzling persistence of the distance effect on bilateral trade. Rev. Econ. Statist. 90(1):37-48.
13. Forman C, Ghose A, Goldfarb A (2009) Competition between local and electronic markets: How the benefit of buying onine depends on where you live. Management Sci. 55(1):47-57.
14. Forman C, Ghose A, Wiesenfeld B (2008) Examining the relationship between reviews and sales: The role of reviewer identity disclosure in electronic markets. Inform. Systems Res. 19(3):291-313.
15. Gefen D, Carmel E (2008) Is the world really flat? A look at offshoring at an online programming marketplace. MIS Quart. 32(2):367-384.
16. Ghose A (2009) Internet exchanges for used goods: An empirical analysis of trade patterns and adverse selection 1. MIS Quart. 33(2):263-292.
17. Ghose A, Yang S (2009) An empirical analysis of search engine advertising: Sponsored search in electronic markets. Management Sci. 55(10):1605-1622.
18. Ghose A, Yao Y (2011) Using transaction prices to re-examine price dispersion in electronic markets. Inform. Systems Res. 22(2):1-17.
19. Ghose A, Smith M, Telang R (2006) Internet exchanges for used books: An empirical analysis of product cannibalization and welfare impact. Inform. Systems Res. 17(1):3-19.
20. Goldfarb A, Lu Q (2006) Household-specific regressions using clickstream data. Statist. Sci. 21(2):247-255.
21. Goolsbee A (2000) What happens when you tax the rich? Evidence from executive compensation. J. Polit. Econom. 108(2):352-378.
22. Goolsbee A, Guryan J (2006) The impact of Internet subsidies in public schools. Rev. Econom. Statist. 88(2):336-347.
23. Gordon L, Loeb MP, Sohail T (2010) Market value of voluntary disclosures concerning information security. Management Inform. Systems Quart. 34(3):567-594.
24. Greene W (2003) Econometric Analysis, 5th ed. (Prentice Hall, Upper Saddle River, NJ).
25. Hubbard R, Armstrong J (2006) Why we don't really know what statistical significance means: A major educational failure. J. Marketing Ed. 28:114-120.
26. Iglesias FH, Riboud M (1988) Intergenerational effects on fertility behavior and earnings mobility in spain. Rev. Econom. Statist. 70(2):253-258.
27. Jones Q, Ravid G, Rafaeli S (2004) Information overload and the message dynamics of online interaction spaces: A theoretical model and empirical exploration. Inform. Systems Res. 15(2):194-210.
28. Leamer E (1978) Specification Searches: Ad Hoc Inference with Nonexperimental Data (John Wiley & Sons, Hoboken, NJ).
29. Li X, Hitt L (2008) Self selection and information role of online product reviews. Inform. Systems Res. 19(4):456-474.
30. Lucking-Reiley D, Bryan D, Prasad N, Reeves D (2007) Pennies from ebay: The determinants of price in online auctions. J. Indust. Econom. 55(2):223-233.
31. Mithas S, Krishnan M (2008) Human capital and institutional effects in the compensation of information technology professionals in the United States. Management Sci. 54(3):415-428.
32. Mithas S, Lucas HC Jr (2010) Are foreign IT workers cheaper? U.S. visa policies and compensation of information technology professionals. Management Sci. 56(5):745-765.
33. Moon JY, Sproull LS (2008) The role of feedback in managing the Internet-based volunteer work force. Inform. Systems Res. 19(4):494-515.
34. Overby E, Jap S (2009) Electronic and physical market channels: A multiyear investigation in a market for products of uncertain quality. Management Sci. 55(6):940-957.
35. Pavlou P, Dimoka A (2006) The nature and role of feedback text comments in online marketplaces: Implications for trust building, price premiums, and seller differentiation. Inform. Systems Res. 17(4):392-414.
36. Sawyer A, Peter J (1983) The significance of statistical significance tests in marketing research. J. Marketing Res. 20(2):122-133.
37. Shmueli G (2010) To explain or to predict? Statist. Sci. 25(3): 289-310.
38. Shmueli G, Koppius O (2011) Predictive analytics in information systems research. Management Inform. Systems Quart. 35(3):553-572.
39. Smith MD, Telang R (2009) Competing with free: The impact of movie broadcasts on DVD sales and Internet piracy 1. MIS Quart. 33(2):321-338.
40. Thompson B (1989) Statistical significance, result importance, and result generalizability: Three noteworthy but somewhat different issues. Measurement and Evaluation in Counseling and Development 22(1):2-6.
41. Tukey J (1991) The philosophy of multiple comparisons. Statist. Sci. 6(1):100-116.
42. Vissing-Jørgensen A (2002) Limited asset market participation and the elasticity of intertemporal substitution. J. Polit. Econom. 110(4):825-853.
43. Vittinghoff E, Glidden D, Shiboski SC, McCulloch CE (2005) Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models (Springer-Verlag, New York).
44. Yao Y, Dresner M, Palmer J (2009) Private network EDI vs. Internet electronic markets: A direct comparison of fulfillment performance. Management Sci. 55(5):843-852.
45. Ziliak S, McCloskey D (2008) The Cult of Statistical Significance (University of Michigan Press, Ann Arbor).