Best-Practice Recommendations for Defining, Identifying, and Handling Outliers

Organizational Research Methods

Volumn 16, Issue 2, 2013, Pages 270-301

  Aguinis, Herman ^a   Gottfredson, Ryan K ^a   Joo, Harry ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

ethics in research; outliers; quantitative research

Indexed keywords

EID: 84875025715     PISSN: 10944281     EISSN: 15527425     Source Type: Journal    
DOI: 10.1177/1094428112470848     Document Type: Review

References (73)

1. Aguinis H.Regression analysis for categorical moderators. New York, NY: Guilford; 2004:.
2. Aguinis H.,Forcum L. E.,Joo H.Using market basket analysis in management research.Journal of Management. in press;:.
3. Aguinis H.,Pierce C. A.,Bosco F. A.,Muslin I. S.First decade of Organizational Research Methods: Trends in design, measurement, and data-analysis topics.Organizational Research Methods. 2009;12:69-112.
4. Aguinis H.,Werner S.,Abbott J. L.,Angert C.,Park J. H.,Kohlhausen D.Customer-centric science: Reporting significant research results with rigor, relevance, and practical impact in mind.Organizational Research Methods. 2010;13:515-539.
5. Amiot C. E.,Terry D. J.,Jimmieson N. L.,Callan V. J.A longitudinal investigation of coping processes during a merger: Implications for job satisfaction and organizational identification.Journal of Management. 2006;32:552-574.
6. Aytug Z. G.,Rothstein H. R.,Zhou W.,Kern M. C.Revealed or concealed? Transparency of procedures, decisions, and judgment calls in meta-analyses.Organizational Research Methods. 2012;15:103-133.
7. Barnett V.,Lewis T.Outliers in statistical data. 1994). Outliers in statistical data (3rd ed.). New York, NY: John Wiley.New York, NY: John Wiley; 1994:.
8. Becker C.,Gather U.The masking breakdown point of multivariate outlier identification rules.Journal of the American Statistical Association. 1999;94:947-955.
9. Belsley D. A.,Kuh E.,Welsh R. E.Regression diagnostics: Identifying influential data and sources of collinearity. New York, NY: John Wiley; 1980:.
10. Blanton H.,Jaccard J.,Klick J.,Mellers B.,Mitchell G.,Tetlock P. E.Strong claims and weak evidence: Reassessing the predictive validity of the IAT.Journal of Applied Psychology. 2009a;94:567-582.
11. Blanton H.,Jaccard J.,Klick J.,Mellers B.,Mitchell G.,Tetlock P. E.Transparency should trump trust: Rejoinder to McConnell and Leibold (2009) and Ziegert and Hanges (2009).Journal of Applied Psychology. 2009b;94:598-603.
12. Bollen K. A.,Jackman R. W.Modern methods of data analysis. Fox J.Long J. S., ed. Newbury Park, CA: Sage; 1990:257-291.
13. Brown D. J.,Cober R. T.,Kane K.,Levy P. E.,Shalhoop J.Proactive personality and the successful job search: A field investigation with college graduates.Journal of Applied Psychology. 2006;91:717-726.
14. Brutus S.,Aguinis H.,Wassmer U.Self-reported limitations and future directions in scholarly reports: Analysis and recommendations.Journal of Management. 2013;39:.
15. Byrne B. M.Structural equation modeling with AMOS, EQS, and LISREL: Comparative approaches to testing for the factorial validity of a measuring instrument.International Journal of Testing. 2001;1:55-86.
16. Cohen J.,Cohen P.,West S. G.,Aiken L. S.Applied multiple regression/correlation analysis for the behavioral sciences. 2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum.Mahwah, NJ: Lawrence Erlbaum; 2003:.
17. Colbert A. E.,Kristof-Brown A. L.,Bradley B. H.,Barrick M. R.CEO transformational leadership: The role of goal importance congruence in top management teams.Academy of Management Journal. 2008;51:81-96.
18. Cortina J. M.Big things have small beginnings: An assortment of "minor" methodological misunderstandings.Journal of Management. 2002;28:339-362.
19. Diener E.Subjective well-being: The science of happiness and a proposal for a national index.American Psychologist. 2000;55:34-43.
20. Edwards J. R.,Cable D. M.The value of value congruence.Journal of Applied Psychology. 2009;94:654-677.
21. Edwards J. R.,Cable D. M.,Williamson I. O.,Lambert L. S.,Shipp A. J.The phenomenology of fit: Linking the person and environment to the subjective experience of person-environment fit.Journal of Applied Psychology. 2006;91:802-827.
22. Fidell L. S.,Tabachnick B. G.Handbook of psychology: Research methods in psychology. Schinka J. A.Velicer W. F., ed. New York, NY: John Wiley; 2003:115-141.
23. Gladwell M.Outliers: The story of success. New York, NY: Little, Brown; 2008:.
24. Godfrey P. C.,Merrill C. B.,Hansen J. M.The relationship between corporate social responsibility and shareholder value: An empirical test of the risk management hypothesis.Strategic Management Journal. 2009;30:425-445.
25. Goerzen A.,Beamish P. W.The effect of alliance network diversity on multinational enterprise performance.Strategic Management Journal. 2005;26:333-354.
26. Grubbs F. E.Procedures for detecting outlying observations in samples.Technometrics. 1969;11:1-21.
27. Hawawini G.,Subramanian V.,Verdin P.Is performance driven by industry- or firm-specific factors? A new look at the evidence.Strategic Management Journal. 2003;24:1-16.
28. Hitt M. A.,Harrison J. S.,Ireland R. D.,Best A.Attributes of successful and unsuccessful acquisitions of US firms.British Journal of Management. 1998;9:91-114.
29. Hollenbeck J. R.,DeRue D. S.,Mannor M.Statistical power and parameter stability when subjects are few and tests are many: Comment on Peterson, Smith, Martorana, and Owens (2003).Journal of Applied Psychology. 2006;91:1-5.
30. Hox J. J.Multilevel analysis: Techniques and applications. 2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge.New York, NY: Routledge; 2010:.
31. Huffman M. L.,Cohen P. N.,Pearlman J.Engendering change: Organizational dynamics and workplace gender desegregation, 1975-2005.Administrative Science Quarterly. 2010;55:255-277.
32. Hunter J. E.,Schmidt F. L.Methods of meta-analysis: Correcting error and bias in research findings. 2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2004:.
33. Jasso G.Marital coital frequency and the passage of time: Estimating the separate effects of spouses' ages and marital duration, birth and marriage cohorts, and period influences.American Sociological Review. 1985;50:224-241.
34. Kahn J. R.,Udry J. R.Marital coital frequency: Unnoticed outliers and unspecified interactions lead to erroneous conclusions.American Sociological Review. 1986;51:734-737.
35. Kruschke J. K.,Aguinis H.,Joo H.The time has come: Bayesian methods for data analysis in the organizational sciences.Organizational Research Methods. 2012;15:722-752.
36. Kulich C.,Trojanowski G.,Ryan M. K.,Haslam S. A.,Renneboog L. D. R.Who gets the carrot and who gets the stick? Evidence of gender disparities in executive remuneration.Strategic Management Journal. 2011;32:301-321.
37. Kutner M. H.,Nachtsheim C. J.,Neter J.,Li W.Applied linear statistical models. 2004). Applied linear statistical models (5th ed.). Boston: McGraw-Hill/Irwin.Boston: McGraw-Hill/Irwin; 2004:.
38. Langford I. H.,Lewis T.Outliers in multilevel data.Journal of the Royal Statistical Society, Series A. 1998;161:121-160.
39. Leung K.Presenting post hoc hypotheses as a priori: Ethical and theoretical issues.Management and Organization Review. 2011;7:471-479.
40. Locke E. A.The case for inductive theory building.Journal of Management. 2007;33:867-890.
41. Martin M. A.,Roberts S.Jackknife-after-bootstrap regression influence diagnostics.Journal of Nonparametric Statistics. 2010;22:257-269.
42. Martin N.,Pardo L.On the asymptotic distribution of Cook's distance in logistic regression models.Journal of Applied Statistics. 2009;36:1119-1146.
43. Mathieu J. E.,Aguinis H.,Culpepper S. A.,Chen G.Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling.Journal of Applied Psychology. 2012;97:951-966.
44. McConnell A. R.,Leibold J. M.Relations among the Implicit Association Test, discriminatory behavior, and explicit measures of racial attitudes.Journal of Experimental Social Psychology. 2001;37:435-442.
45. McConnell A. R.,Leibold J. M.Weak criticisms and selective evidence: Reply to Blanton et al.(2009).Journal of Applied Psychology. 2009;94:583-589.
46. McNamara G.,Aime F.,Vaaler P. M.Is performance driven by industry- or firm-specific factors? A response to Hawawini, Subramanian, and Verdin.Strategic Management Journal. 2005;26:1075-1081.
47. Mohrman S. A.,Lawler E. E.,.Generating knowledge that drives change.Academy of Management Perspectives. 2012;26:41-51.
48. O'Boyle E.,Aguinis H.The best and the rest: Revisiting the norm of normality of individual performance.Personnel Psychology. 2012;65:79-119.
49. Orr J. M.,Sackett P. R.,DuBois C. L. Z.Outlier detection and treatment in I/O psychology: A survey of researcher beliefs and an empirical illustration.Personnel Psychology. 1991;44:473-486.
50. Pek J.,MacCallum R. C.Sensitivity analysis in structural equation models: Cases and their influence.Multivariate Behavioral Research. 2011;46:202-228.
51. Peterson R. S.,Smith D. B.,Martorana P. V.,Owens P. D.The impact of chief executive officer personality on top management team dynamics: One mechanism by which leadership affects organizational performance.Journal of Applied Psychology. 2003;88:795-808.
52. Pierce J. R.,Aguinis H.The too-much-of-a-good-thing effect in management.Journal of Management. 2013;39 (2): 313-338.
53. Raudenbush S. W.,Bryk A. S.,Cheong Y. F.,Congdon R. T.,Du Toit M.HLM 6: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International; 2004:.
54. Reuer J. J.,Ariño A.Contractual renegotiations in strategic alliances.Journal of Management. 2002;28:47-68.
55. Rousseeuw P. J.,Leroy A. M.Robust regression and outlier detection. Hoboken, NJ: John Wiley; 2003:.
56. Seligman M. E. P.,Csikszentmihalyi M.Positive psychology: An introduction.American Psychologist. 2000;55:5-14.
57. Shepherd D. A.,Sutcliffe K. M.Inductive top-down theorizing: A source of new theories of organization.Academy of Management Review. 2011;36:361-380.
58. Shi L.,Chen G.Detection of outliers in multilevel models.Journal of Statistical Planning and Inference. 2008;138:3189-3199.
59. Smillie L. D.,Yeo G. B.,Furnham A. F.,Jackson C. J.Benefits of all work and no play: The relationship between neuroticism and performance as a function of resource allocation.Journal of Applied Psychology. 2006;91:139-155.
60. Snijders T. A. B.,Berkhof J.Handbook of multilevel analysis. de Leeuw J.Meijer E., ed. New York, NY: Springer; 2008:141-176.
61. Snijders T. A. B.,Bosker R. J.Multilevel analysis: An introduction to basic and advanced multilevel modeling. 2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2012:.
62. St. John C. H.,Harrison J. S.Manufacturing-based relatedness, synergy, and coordination.Strategic Management Journal. 1999;20:129-145.
63. Tabachnick B. G.,Fidell L. S.Using multivariate statistics. 2007). Using multivariate statistics (5th ed.). Boston, MA: Pearson.Boston, MA: Pearson; 2007:.
64. Tomarken A. J.,Waller N. G.Structural equation modeling: Strengths, limitations, and misconceptions.Annual Review of Clinical Psychology. 2005;1:31-65.
65. Van Dick R.,Van Knippenberg D.,Kerschreiter R.,Hertel G.,Wieseke J.Interactive effects of work group and organizational identification on job satisfaction and extra-role behavior.Journal of Vocational Behavior. 2008;72:388-399.
66. Wanberg C. R.,Glomb T. M.,Song Z.,Sorenson S.Job-search persistence during unemployment: A 10-wave longitudinal study.Journal of Applied Psychology. 2005;90:411-430.
67. Wiggins R. R.,Ruefli T. W.Schumpeter's ghost: Is hypercompetition making the best of times shorter?.Strategic Management Journal. 2005;26:887-911.
68. Worren N.,Moore K.,Cardona P.Modularity, strategic flexibility, and firm performance: A study of the home appliance industry.Strategic Management Journal. 2002;23:1123-1140.
69. Yuan K.-H.,Bentler P. M.Structural equation modeling with robust covariances.Sociological Methodology. 1998;28:363-396.
70. Yuan K.-H.,Zhong X.Outliers, leverage observations, and influential cases in factor analysis: Using robust procedures to minimize their effect.Sociological Methodology. 2008;38:329-368.
71. ZhangZ.YuanK.-H. (2012). semdiag: Structural equation modeling diagnostics (R Package Version 0.1.2) [Computer software manual]. Retrieved fromhttp://cran.at.r-project.org/web/packages/semdiag/semdiag.pdf.
72. Zhong X.,Yuan K.-H.Bias and efficiency in structural equation modeling: Maximum likelihood versus robust methods.Multivariate Behavioral Research. 2011;46:229-265.
73. Ziegert J. C.,Hanges P. J.Strong rebuttal for weak criticisms: Reply to Blanton et al.(2009).Journal of Applied Psychology. 2009;94:590-597.