Exploratory data analysis as a foundation of inductive research

Human Resource Management Review

Volumn 27, Issue 2, 2017, Pages 265-276

  Jebb, Andrew T ^a   Parrigon, Scott ^a   Woo, Sang Eun ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

Exploratory data analysis; Inductive; Phenomenon detection; Replication; Visualization

Indexed keywords

EID: 84981747072     PISSN: 10534822     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.hrmr.2016.08.003     Document Type: Article

References (77)

1. Aguinis, H., Gottfredson, R.K., Best-practice recommendations for estimating interaction effects using moderated multiple regression. Journal of Organizational Behavior 31:6 (2010), 776–786.
2. Aguinis, H., Gottfredson, R.K., Culpepper, S.A., Best-practice recommendations for estimating cross-level interaction effects using multilevel modeling. Journal of Management 39 (2013), 1490–1528.
3. Bakker, M., van Dijk, A., Wicherts, J.M., The rules of the game called pychological science. Perspectives on Psychological Science 7:6 (2012), 543–554.
4. Behrens, J.T., Principles and procedures of exploratory data analysis. Psychological Methods 2:2 (1997), 131–160.
5. Behrens, J.T., Yu, C.-H., Exploratory data analysis. Schinka, J.A., Velicer, W.F., (eds.) Handbook of psychology, Vol. 2, 2003, Wiley, New York, 33–64.
6. Bosco, F.A., Aguinis, H., Field, J.G., Pierce, C.A., Dalton, D.R., HARKing's threat to organizational research: Evidence from primary and meta-analytic sources. Personnel Psychology 69:3 (2016), 709–750, 10.1111/peps.12111.
7. Braun, M.T., Oswald, F.L., Exploratory regression analysis: A tool for selecting models and determining predictor importance. Behavior Research Methods 43:2 (2011), 331–339, 10.3758/s13428-010-0046-8.
8. Brown, T.A., Confirmatory factor analysis for applied research. 2006, Guilford Press, New York.
9. Button, K.S., Ioannidis, J.P.A., Mokrysz, C., Nosek, B.A., Flint, J., Robinson, E.S.J., Munafo, M.R., Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience 14 (2013), 365–376.
10. Carter, N.T., Dalal, D.K., Boyce, A.S., O'Connell, M.S., Kung, M.-C., Delgado, K.M., Uncovering curvilinear relationships between conscientiousness and job performance: How theoretically appropriate measurement makes an empirical difference. Journal of Applied Psychology 99:4 (2014), 564–586, 10.1037/a0034688.
11. Cleveland, W.S., Visualizing data. 1994, AT&T Bell Laboratories, Murray Hill, N.J.
12. du Toit, S.H.C., Steyn, A.G.W., Stumpf, R.H., Graphical exploratory data analysis. 1986, Springer-Verlag, New York.
13. Eden, D., From the editors: Replication, meta-analysis, scientific progress, and AMJ's publication policy. The Academy of Management Journal 45:5 (2002), 841–846.
14. Efron, B., Hastie, T., Johnstone, I., Tibshirani, R., Least angle regression. Annals of Statistics 32:2 (2004), 407–499, 10.1214/009053604000000067.
15. Emerson, J.D., Stoto, M.A., Transforming data. Hoaglin, D.C., Mosteller, F., Tukey, J.W., (eds.) Understanding robust and exploratory data analysis, 1983, Wiley, New York, 97–128.
16. Erickson, B.H., Nosanchuk, T.A., Understanding data. 1977, McGraw-Hili Ryerson, Toronto.
17. Frank, M.C., Saxe, R., Teaching replication. Perspectives on Psychological Science 7:6 (2012), 600–604, 10.1177/1745691612460686.
18. Gelman, A., Interrogating p-values. Journal of Mathematical Psychology 57 (2013), 188–189, 10.1016/j.jmp.2013.03.005.
19. Gelman, A., The connection between varying treatment effects and the crisis of unreplicable research: A Bayesian perspective. Journal of Management 41:2 (2015), 632–643, 10.1177/0149206314525208.
20. Gelman, A., Loken, E., The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis. Technical report, 2013, Department of Statistics, Columbia University, New York, NY.
21. Haig, B.D., An abductive theory of scientific method. Psychological Methods 10:4 (2005), 371–388, 10.1037/1082-989X.10.4.371.
22. Halford, G.S., Wilson, W.H., Phillips, S., Processing capacity defined by relational complexity: Implications for comparative, developmental, and cognitive psychology. The Behavioral and Brain Sciences 21:6 (1998), 803–831, 10.1017/S0140525X98001769 (discussion 831–864).
23. Halford, G.S., Baker, R., McCredden, J.E., Bain, J.D., How many variables can humans process?. Psychological Science 16 (2005), 70–76.
24. Hambrick, D., The field of management's devotion to theory: Too much of a good thing?. Academy of Management Journal 50:6 (2007), 1346–1352.
25. Hartwig, F., Dearing, B.E., Exploratory data analysis. 1979, Sage, Beverly Hills, CA.
26. Hedges, L.V., Pigott, T.D., The power of statistical tests for moderators in meta- analysis. Psychological Methods 9 (2004), 426–445.
27. Hinkin, T.R., A brief tutorial on the development of measures for use in survey question questionnaires. Organizational Research Methods 1 (1998), 104–121.
28. Hyndman, R.J., Athanasopoulos, G., Forecasting: Principles and practice. 2014, OTexts (Retrieved from http://otexts.org/fpp/).
29. Ioannidis, J.P., Why most published research findings are false. PLoS Medicine, 2(8), 2005, e124, 10.1371/journal.pmed.0020124.
30. John, L.K., Loewenstein, G., Prelec, D., Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science 23:5 (2012), 524–532, 10.1177/0956797611430953.
31. Kepes, S., McDaniel, M., How trustworthy is the scientific literature in industrial and organizational osychology?. Industrial and Organizational Psychology 6 (2013), 252–268 (Retrieved from http://onlinelibrary.wiley.com/doi/10.1111/iops.12045/full).
32. Kerr, N.L., HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review 2 (1998), 196–217.
33. Kline, R.B., Principles and practice of structural equation modeling. 2011, Guilford Press, New York, NY.
34. Koole, S.L., Lakens, D., Rewarding replications: A sure and simple way to improve psychological science. Perspectives on Psychological Science 7:6 (2012), 608–614, 10.1177/1745691612462586.
35. LeBreton, J., Editorial. Organizational Research Methods 19:1 (2016), 3–7.
36. Leinhardt, G., Leinhardt, S., Exploratory data analysis: New tools for the analysis of empirical data. Berliner, D., (eds.) Review of research in education, Vol. 8, 1980, 85–157.
37. Leinhardt, S., Wasserman, S.S., Exploratory data analysis: An introduction to selected methods. Schuesler, K.F., (eds.) Sociological methodology, 1979, Jossey-Bass, San Francisco, 311–365.
38. MacKinnon, D.P., Lockwood, C.M., Hoffman, J.M., West, S.G., Sheets, V., A comparison of methods to test mediation and other intervening variable effects. Psychological Methods 7 (2002), 83–104.
39. Makel, M.C., Plucker, J.A., Hegarty, B., Replications in psychology research: How often do they really cccur?. Perspectives on Psychological Science 7:6 (2012), 537–542, 10.1177/1,745,691,612,460,688.
40. Mathieu, J.E., Aguinis, H., Culpepper, S.A., Chen, G., Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling. Journal of Applied Psychology 97 (2012), 951–966.
41. McNeil, D.R., Interactive data analysis. 1977, John Wiley & Sons, New York.
42. Mosteller, F., Tukey, J.W., Data analysis and regression. 1977, Addison-Wesley, Reading, Mass.
43. Mueller, C.W., Exploratory data analysis. Administrative Science Quarterly 25:4 (1980), 700–703.
44. Muller, D., Judd, C.M., Yzerbyt, V.Y., When moderation is mediated and mediation is moderated. Journal of Personality and Social Psychology 89 (2005), 852–863.
45. Myatt, G.J., Johnson, Making sense of data: A practical guide to exploratory data analysis and data mining. 2nd ed., 2014, John Wiley and Sons, New Jersey.
46. Neuliep, J.W., Crandall, R., Editorial bias against replication research. Journal of Social Behavior and Personality 5 (1990), 85–90.
47. Neuliep, J.W., Crandall, R., Reviewer bias against replication research. Journal of Social Behavior and Personality 8 (1993), 21–29.
48. Nosek, B.A., Lakens, D., Registered reports. Social Psychology 45:3 (2014), 137–141, 10.1027/1864–9335/a000192.
49. O′Boyle, E.H., Banks, G.C., Gonzalez-Mule, E., The chrysalis effect: How ugly initial results metamorphosize into beautiful articles. Journal of Management, 2016 (in press).
50. Open Science Collaboration. Estimating the reproducibility of psychological science. Science, 349(6251), 2015, 10.1126/science.aac4716.
51. Pashler, H., Wagenmakers, E.-J., Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence?. Perspectives on Psychological Science 7:6 (2012), 528–530, 10.1177/1745691612465253.
52. Sagarin, B.J., Ambler, J.K., Lee, E.M., An ethical approach to peeking at data. Perspectives on Psychological Science 9:3 (2014), 293–304, 10.1177/1745691614528214.
53. Sharpe, D., Why the resistance to statistical innovations? Bridging the communication gap. Psychological Methods 18:4 (2013), 572–582, 10.1037/a0034177.
54. Shaver, J.P., What statistical significance testing is, and what it is not. Journal of Experimental Education 61 (1993), 293–316.
55. Simmons, J.P., Nelson, L.D., Simonsohn, U., False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science 22:11 (2011), 1359–1366, 10.1177/0956797611417632.
56. Simonsohn, U., Posterior-hacking: Selective reporting invalidates Bayesian results also., 2014 Retrieved from http://ssrn.com/abstract=2374040.
57. Singer, J.D., Willett, J.B., Improving the teaching of applied statistics: Putting the data back into data analysis. The American Statistician 44 (1990), 223–230.
58. Spector, P.E., Rogelberg, S.G., Ryan, A.M., Schmitt, N., Zedeck, S., Moving the pendulum back to the middle: Reflections on and introduction to the inductive research special issue of journal of business and psychology. Journal of Business and Psychology 29 (2014), 499–502, 10.1007/s10869–014–9372-7.
59. Sutton, R.I., Staw, B.M., What theory is not. Administrative Science Quarterly 40 (1995), 371–384.
60. Tay, L., Parrigon, S., Huang, Q., LeBreton, J., Perspectives on Psychological Science, 2016 (in press).
61. Theus, M., Urbanek, S., Interactive graphics for data analysis: Principles and examples. 2008, Chapman & Hall/CRC Press.
62. Tibshirani, R., Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society B 58 (1996), 267–288.
63. Torgo, L., Data mining with R. 2011, Taylor & Francis, Boca Raton, FL.
64. Tufte, E.R., The visual display of quantitative information. 1983, Graphics Press, Cheshire, CT.
65. Tukey, J.W., Exploratory data analysis. 1977, Addison Wesley, Reading, MA.
66. Tukey, J.W., We need both exploratory and confirmatory. The American Statistician 34 (1980), 23–25, 10.1080/00031305.1980.10482706.
67. Tukey, J.W., Exploratory data analysis: Past, present and future. Technical report no. 302, 1993, Princeton University, Priceton, NJ.
68. Unwin, A., Graphical data analysis with R. 2015, Chapman & Hall/CRC Press, Boca Raton, FL.
69. Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H.L.J., Why psychologists must change the way they analyze their data: The case of psi. Journal of Personality and Social Psychology 100:3 (2011), 426–432, 10.1037/a0022790.
70. Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H.L.J., Kievit, R.A., An agenda for purely confirmatory research. Perspectives on Psychological Science 7:6 (2012), 632–638, 10.1177/1745691612463078.
71. Wagenmakers, E.-J., Wetzels, R., Borsboom, D., Kievit, R., van der Maas, H.L.J., A skeptical eye on psi. May, E., Marwaha, S., (eds.) Extrasensory perception: Support, skepticism, and science, 2015, ABC-CLIO, NB, 153–176.
72. Wigboldus, D.H.L., Dotsch, R., Encourage playing with data and discourage questionable reporting practices. Psychometrika 81:1 (2015), 27–32.
73. Williams, G., Data mining with rattle and R. 2011, Springer, New York.
74. Woo, S.E., Allen, D.G., Toward an inductive theory of stayers and seekers in the organization. Journal of Business and Psychology 29 (2014), 683–703, 10.1007/s10869-013-9303-z.
75. Woo, S.E., Chae, M.W., Jebb, A.T., Kim, Y.D., A closer look at the personality-turnover relationship: Criterion expansion, dark traits, and time. Journal of Management 42:2 (2016), 357–385.
76. Zhao, Y., R and data mining: Examples and case studies. 2013, Academic Press, London.
77. Zou, H., Hastie, T., Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society B 67 (2005), 301–320.