This Is How We Do Research Around Here: Socializing Methodological and Measurement Issues

The Oxford Handbook of Organizational Socialization

Volumn , Issue , 2012, Pages

  Vancouver, Jeffrey B ^a   Warren, Michael A ^a  

^a OHIO UNIVERSITY   (United States)

Author keywords

Computational models; Longitudinal designs; Quasi experimental designs; Research methods; Socialization; Validity

Indexed keywords

EID: 84925115724     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/oxfordhb/9780199763672.013.0010     Document Type: Chapter

References (110)

1. Aguinis, H., Pierce, C. A., Bosco, F. A., & Muslin, I. S., (2009). First decade of organizational research methods: Trends in design, measurement, and data analysis topics. Organizational Research Methods, 12, 69-112.
2. Alliger, G. M., Tannenbaum, S. I., Bennett, W., Traver, H., et al. (1997). A meta-analysis of the relations among training criteria. Personnel Psychology, 50, 341-358.
3. Anderson, C. A., Lindsay, J. J., & Bushman, B. J., (1999). Research in the psychological laboratory: Truth or triviality? Current Directions in Psychological Science, 8, 3-9.
4. Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R., (2010). On making causal claims: A review and recommendations. The Leadership Quarterly, 21, 1086-1120.
5. Aronson, E., Ellsworth, P. C., Carlsmith, J. M., & Gonzales, M. H., (1990). Methods of research in social psychology (2nd ed.). New York: McGraw-Hill.
6. Ashford, S. J., (1986). The role of feedback seeking in individual adaptation: A resource perspective. Academy of Management Journal, 29, 465-487.
7. Ashford, S. J., & Cummings, L. L., (1983). Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior & Human Performance, 32: 370-398.
8. Austin, J. T., Scherbaum, C. A., & Mahlman, R. A., (2002). History of research methods in industrial and organizational psychology: Measurement, design, analysis. In S. G. Rogelberg (Ed.), Handbook of research methods in industrial and organizational psychology. (pp. 3-33) Malden, MA: Blackwell Publishing.
9. Baker, T. B., McFall, R. M., & Shoham, V., (2008). Current status and future prospects of clinical psychology: Toward a scientifically principled approach to mental and behavioral health care. Psychological Science in the Public Interest, 9, 67-103.
10. Bandura, A., & Wood, R., (1989). Effect of perceived controllability and performance standards on self-regulation of complex decision making. Journal of Personality and Social Psychology, 56, 805-814.
11. Baron, R. M., & Kenny, D. A., (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182.
12. Bauer, T. N., Bodner, T., Erdogan, B., Truxillo, D. M., & Tucker, J. S., (2007). Newcomer adjustment during organizational socialization: A meta-analytic review of antecedents, outcomes, and methods. Journal of Applied Psychology, 92, 707-721.
13. Bauer, T. N., & Erdogan, B., (2011). Organizational socialization: The effective onboarding of new employees. In S. Zedeck (Ed.), APA handbook of industrial and organizational psychology,: Maintaining, expanding, and contracting the organization Vol. 3 (pp. 51-64). Washington, DC: American Psychological Association.
14. Bauer, T. N., Morrison, E. W., & Callister, R. R., (1998). Organizational socialization: A review and directions for future research. Research in Personnel and Human Resource Management, 16, 149-214.
15. Beal, D. J., & Weiss, H. M., (2003). Methods of ecological momentary assessment in organizational research. Organizational Research Methods, 6, 440-464.
16. Berger, C. R., & Calabrese, R. J., (1975). Some explorations in initial interaction and beyond: Toward a developmental theory of interpersonal communication. Human Communication Research, 1, 99-112.
17. Bitektine, A., (2008). Prospective case study design: Qualitative method for deductive theory testing. Organizational Research Methods, 11, 160-180.
18. Bliese, P. D., & Ployhart, R. E., (2002). Growth modeling using random coefficient models: Model building, testing, and illustration. Organizational Research Methods, 5 (4), 362-387.
19. Bolger, N., Davis, A., & Rafaeli, E., (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579-616.
20. Boswell, W. R., Shipp, A. J., Culbertson, S. S., & Payne, S. C., (2009). Changes in newcomer job satisfaction over time: Examining the pattern of honeymoons and hangovers. Journal of Applied Psychology, 94, 844-858.
21. Briner, R. B., & Rousseau, D. M., (2011). Evidence-based I-O psychology: Not there yet. Industrial and Organizational Psychology: Perspectives on Science and Practice, 4, 3-22.
22. Buckley, M. R., Mobbs, T. A., Mendoza, J. L., Novicevic, M. M., Carraher, S. M., & Beu, D. S., (2002). Implementing realistic job previews and expectation-lowering procedures: A field experiment. Journal of Vocational Behavior, 61, 263-278.
23. Buttigieg, D. M., Deery, S. J., & Iverson, R. D., (2007). An event history analysis of union joining and leaving. Journal of Applied Psychology, 92, 829-839.
24. Campbell, D. T., (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54, 297-312.
25. Campbell, J. P., (1990). An overview of the army selection and classification project (Project A). Personnel Psychology, 43, 231-239.
26. Campbell, J. P., Daft, R. L., & Hulin, C. L., (1982). What to study: Generating and developing research questions. Beverly Hills, CA: Sage Publications.
27. Campbell, D. T., Stanley, J. C., & Gage, N. L., (1963). Experimental and quasi-experimental designs for research. Boston, MA: Houghton, Mifflin.
28. Carr, J. C., Pearson, A. W., Vest, M. J., & Boyar, S. L., (2006). Prior occupational experience, anticipatory socialization, and employee retention. Journal of Management, 32, 343-359.
29. Chao, G. T., O'Leary-Kelly, A. M., Wolf, S., Klein, H. J., & Gardner, P. D., (1994). Organizational socialization: Its content and consequences. Journal of Applied Psychology, 79, 730-743.
30. Chan, D., (2002). Latent growth modeling. In F. Drasgow & N. Schmitt (Eds.), Measuring and analyzing behavior in organizations: Advances in measurement and data analysis (pp. 302-349). San Francisco, CA: Jossey-Bass.
31. Chan, D., & Schmitt, N., (2000). Interindividual differences in intraindividual changes in proactivity during organizational entry: A latent growth modeling approach to understanding newcomer adaptation. Journal of Applied Psychology, 85, 190-210.
32. Charrington, D. J., Reitz, H. J., & Scott, W. E., (1971). Effects of contingent and noncontingent reward on the relationship between satisfaction and task performance. Journal of Applied Psychology, 55, 531-536.
33. Chen, G., (2005). Newcomer adaptation in teams: multilevel antecedents and outcomes. Academy of Management Journal, 48, 101-116.
34. Chen, N. Y., Lu, J., Tjosvold, D., & Lin, C., (2008). Effects of team goal interdependence on newcomer socialization: An experiment in China. Journal of Applied Social Psychology, 38, 198-214.
35. Cook, T. D., & Campbell, D. T., (1979). Quasi-experimentation: Design and analysis for field settings. Chicago, IL: Rand McNally.
36. Cronbach, L. J., (1957). The two disciplines of scientific psychology. American Psychologist, 12, 671-684.
37. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N., (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
38. Cunliffe, A. L., (2010). Retelling tales of the field: In search of organizational ethnography 20 years on. Organizational Research Methods, 13, 224-239.
39. Davis, J. P., Eisenhardt, K. M., & Bingham, C. B., (2007). Developing theory through simulation methods. The Academy of Management Review, 32, 480-499.
40. DiFonzo, N., Hantula, D. A., & Bordia, P., (1998). Microworlds for experimental research: Having your (control and collections) cake, and realism too. Behavior Research Methods, Instruments & Computers, 30, 278-286.
41. Dunning, D., Heath, C., & Suls, J. M., (2004). Flawed self-assessment: Implications for health, education, and the workplace. Psychological Science in the Public Interest, 5, 69-106.
42. Duriau, V. J., Reger, R. K., & Pfarrer, M. D., (2007). A content analysis of the content analysis literature in organizational studies. Organizational Research Methods, 10, 5-34.
43. Easterby-Smith, M., Golden-Biddle, K., & Locke, K., (2008). Working with pluralism: Determining quality in qualitative research. Organizational Research Methods, 11, 419-429.
44. Eby, L. T., (2011). Mentoring. In S. Zedeck (Ed.), APA handbook of industrial and organizational psychology: Selecting and developing members for the organization Vol. 2 (pp. 505-525). Washington DC: American Psychological Association.
45. Frese, M., Garst, H., & Fay, D., (2007). Making things happen: Reciprocal relationships between work characteristics and personal initiative in a four-wave longitudinal structural equation model. Journal of Applied Psychology, 92, 1084-1102.
46. Goldsmith, T. E., Johnson, P. J., & Acton, W. H., (1991). Assessing structural knowledge. Journal of Educational Psychology, 83, 88-96.
47. Goldstein, I. L., & Ford, J. K., (2002). Training in organizations: Needs assessment, development, and evaluation (4th ed.). Belmonc, CA: Wadsworth/Thomson Learning.
48. Glasser, B., & Strauss, A., (1967). The Discovery of grounded theory. Hawthorne, NY: Aldine Publishing Company.
49. Gomez-Mejia, L. R., (1983). Sex differences during occupational socialization. Academy of Management Journal, 26, 492-499.
50. Gonzalez, C., Vanyukov, P., & Martin, M. K., (2005). The use of microworlds to study dynamic decision making. Computers in Human Behavior, 21, 273-286.
51. Goodman, J. S., & Wood, R. E., (2004). Feedback specificity, learning opportunities, and learning. Journal of Applied Psychology, 89, 248-262.
52. Griffeth, R. W., & Vancouver, J. B., (2009, November). Sim Career: Development of a virtual organizational world (VOW) for studying employee turnover processes. Presented at the annual Society of Organizational Behavior conference, University of Maryland, College Park, MD.
53. Grove, D. A. & Ostroff, C., (1991). Program evaluation. In K. Wexley & J. Hinrichs (Eds.), Developing human resources. Washington, DC: BNA Books.
54. Hambrick, D. C., (2007). The field of management's devotion to theory: Too much of a good thing? Academy of Management Journal, 50, 1346-1352.
55. Harrison, J. R., Lin, Z., Carroll, G. R., & Carley, K. M., (2007). Simulation modeling in organizational and management research. The Academy of Management Review, 32, 1229-1245.
56. Haueter, J. A., Macan, T. H., & Winter, J., (2003). Measurement of newcomer socialization: Construct validation of a multidimensional scale. Journal of Vocational Behavior, 63, 20-39.
57. Hulin, C. L., (1991). Adaptation, persistence, and commitment in organizations. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., pp. 443-505). Palo Alto, CA: Consulting Psychologists Press.
58. James, L. R., Mulaik, S. A., & Brett, J. M., (1982). Causal analysis: Assumptions, models, and data. Beverly Hills, CA: Sage Publications.
59. James, L. R., Mulaik, S. A., & Brett, J. M., (2006). A tale of two methods. Organizational Research Methods, 9, 233-244.
60. Jokisaari, M., & Nurmi, J.-E. (2009). Change in newcomers' supervisor support and socialization outcomes after organizational entry. Academy of Management Journal, 52, 527-544.
61. Jones, G. R., (1983). Psychological orientation and the process of organizational socialization: An interactionist perspective. Academy of Management Review, 8, 464-474.
62. Kammeyer-Mueller, J. D., & Wanberg, C. R., (2003). Unwrapping the organizational entry process: Disentangling multiple antecedents and their pathways to adjustment. Journal of Applied Psychology, 88, 779-794.
63. Klein, K. J., & Kozlowski, S. W. J., (2000). Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions. San Francisco, CA: Jossey-Bass.
64. Klein, H. J., & Weaver, N. A., (2000). The effectiveness of an organizational-level orientation training program in the socialization of new hires. Personnel Psychology, 53, 47-66.
65. Kirkpatrick, D. L., (1994). Evaluating training programs: The four levels. San Francisco, CA: Berrett-Koehler.
66. Lee, T. W., Mitchell, T. R., & Harman, W. S., (2011). Qualitative research strategies in industrial and organizational psychology. In S. Zedeck (Ed.), APA handbook of industrial and organizational psychology,: Building and developing the organization Vol 1 (pp. 73-83). Washington, DC: American Psychological Association.
67. Leonardi, P. M., Jackson, M. H., & Diwan, A., (2009). The enactment-externalization dialectic: Rationalization and the persistence of counterproductive technology design practices in student engineering. Academy of Management Journal, 52, 400-420.
68. Locke, E. A., (1986). Generalizing from laboratory to field settings: Research findings from industrial organizational psychology, organizational behavior, and human resource management. Lexington, MA: Lexington Books.
69. McGrath, J. E., Martin, J. M. & Kukla, R. A., (1982). Judgment calls in research. Beverly Hills, CA: Sage Publications.
70. Mohammed, S., Klimoski, R., & Rentsch, J. R., (2000). The measurement of team mental models: We have no shared schema. Organizational Research Methods, 3, 123-165.
71. Morrison, E. W., (2002). Information seeking within organizations. Human Communication Research, 28, 229-242.
72. Motowidlo, S. J., (2003). Job performance. In W. C. Borman, D. R. Ilgen, & R. J. Klimoski (Eds.), Handbook of psychology: Industrial and organizational psychology (Vol. 12, Chapter 3, pp. 39-54). Hoboken, NJ: Wiley.
73. Mellor, S., & Mark, M. M., (1998). A quasi-experimental design for studies on the impact of administrative decisions: Applications and extensions of the regression-discontinuity design. Organizational Research Methods, 1, 315-333.
74. Miller, G. A., & Chapman, J. P., (2001). Misunderstanding analysis of covariance. Journal of Abnormal Psychology, 110, 40-48.
75. Murphy, K. R., & Cleveland, J. N., (1995). Understanding performance appraisal: Social, organizational, and goal based perspectives. Thousand Oaks, CA: Sage.
76. Ostroff, C., & Kozlowski, S. W. J., (1992). Organizational socialization as a learning process: The role of information acquisition. Personnel Psychology, 45, 849-874.
77. Pinto, I. R., Marques, J. M., Levine, J. M., & Abrams, D., (2010). Membership status and subjective group dynamics: Who triggers the black sheep effect? Journal of Personality and Social Psychology, 99, 107-119.
78. Ployhart, R. E., & Vandenberg, R. J., (2010). Longitudinal research: The theory, design, and analysis of change. Journal of Management, 36, 94-120.
79. Poncheri, R. M., Lindberg, J. T., Thompson, L. F., & Surface, E. A., (2008). A comment on employee surveys: Negativity bias in open-ended responses. Organizational Research Methods, 11, 614-630.
80. Putka, D. J., (2002). The variance architecture approach to the study of constructs in organizational contexts. Ph.D. dissertation, Ohio University, United States - Ohio. Retrieved February 7, 2012, from Dissertations & Theses @ Ohio University. (Publication No. AAT 3062641).
81. Reise, S. P., Widaman, K. F., & Pugh, R. H., (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566.
82. Reichers, A. E., (1987). An interactionist perspective on newcomer socialization rates. The Academy of Management Review, 12, 278-287.
83. Roethlisberger, F. J., & Dickson, W. J., (1943). Management and the worker. Cambridge MA: Harvard University Press.
84. Runkel, P. J., & McGrath, J. E., (1972). Research on human behavior: A systematic guide to method. New York: Holt, Rinehart, & Winston.
85. Saari, L. M., Johnson, T. R., McLaughlin, S. D., & Zimmerle, D. M., (1988). A survey of management training and education practices in U.S. companies. Personnel Psychology, 41, 731-743.
86. Sackett, P. R. & Larson, J. R., (1990). Research strategies and tactics in industrial and organizational psychology. In M. D. Dunnett & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 1, pp. 419-489). Palo Alto, CA: Consulting Psychologist Press.
87. Scandura, T. A., & Williams, E. A., (2000). Research methodology in management: Current practices, trends, and implications for future research. Academy of Management Journal, 43, 1248-1264.
88. Schonfeld, I. S., & Rindskopf, D., (2007). Hierarchical linear modeling in organizational research: Longitudinal data outside the context of growth modeling. Organizational Research Methods, 10, 417-429.
89. Shadish, W. R., Cook, T. D., & Campbell, D. T., (2002). Experimental and quasi-experimentation designs for generalized causal inference. Boston, MA: Houghton Mifflin.
90. Singer, J. D., & Willett, J. B., (2003a). Applied longitudinal data analysis: Modeling change and event occurrence. New York: Oxford University Press.
91. Singer, J. D., & Willett, J. B., (2003b). Survival analysis. Handbook of psychology: Research methods in psychology (Vol. 2, pp. 555-580). Hoboken, NJ: John Wiley & Sons.
92. Spencer, S. J., Zanna, M. P., & Fong, G. T., (2005). Establishing a causal chain: Why experiments are often more effect than meditational analyses in examining psychological processes. Journal of Personality and Social Psychology, 89, 846-851.
93. Snow, R. E. & Swanson, J., (1992). Instructional psychology: Aptitude, adaptation, and assessment. Annual Review of Psychology, 43, 583-626.
94. Solomon, R. L., (1949). An extension of control group design. Psychological Bulletin, 46, 137-150.
95. Stone-Romero, E., (2011). Research strategies in industrial and organizational psychology: Nonexperimental, quasi experimental, and randomized experimental research in special purpose and nonspecial purpose settings. In S. Zedeck (Ed.), APA handbook of industrial and organizational psychology,: Building and developing the organization Vol. 1 (pp. 37-72). Washington, DC: American Psychological Association.
96. Stone-Romero, E. F., & Rosopa, P. J., (2004). Inference problems with hierarchical multiple regression-based tests of mediating effects. Research in Personnel and Human Resource Management, 23, 249-290.
97. Stone-Romero, E., Weaver, A. E., & Glenar, J. L., (1995). Trends in research design and data analytic strategies in organizational research. Journal of Management, 21, 141-157.
98. Strauss, A., & Corbin, J., (1994). Grounded theory methodology: An overview. Handbook of qualitative research. (pp. 273-285). Sage Publications, Inc, Thousand Oaks, CA, US.
99. Sun, R., (2008). Introduction to computational cognitive modeling. The Cambridge handbook of computational psychology (pp. 3-19). New York: Cambridge University Press.
100. Taormina, R. J., (1994). The organizational socialization inventory. International Journal of Selection and Assessment, 2, 133-145.
101. Trist, E. L., (1981). The social-technical perspective. In A. H. Van de Ven & W. R. Joyce (Eds.), Perspectives on organizational design and behavior (pp. 19-75). New York: Wiley.
102. Van Maanen, J., & Schein, E. H., (1979). Toward a theory of organizational socialization. In B. Staw (Ed.), Research in organizational behavior (Vol. I, pp. 209-269). Greenwich, CT: JAI Press.
103. Vancouver, J. B., More, K. M., & Yoder, R. J., (2008). Self-efficacy and resource allocation: Support for a discontinuous model. Journal of Applied Psychology, 93, 35-47.
104. Vancouver J. B., Putka, D. J., & Scherbaum, C. A., (2005). Testing a computational model of the goal-level effect: An example of a neglected methodology. Organizational Research Methods, 8, 100-127.
105. Vancouver, J. B., Tamanini, K. B., & Yoder, R. J., (2010). Using dynamic computational models to reconnect theory and research: Socialization by the proactive newcomer example. Journal of Management, 36, 764-793.
106. Vancouver, J. B., Thompson, C. M., & Williams, A. A., (2001). The changing signs in the relationships between self efficacy, personal goals and performance. Journal of Applied Psychology, 86, 605-620.
107. Vidmar, N., (1979). The other issues in jury simulation research: A commentary with particular reference to defendant character studies. Law and Human Behavior, 3, 95-106.
108. Weiss, H. M., (1990). Learning theory and industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), The handbook of industrial/organizational psychology (2nd ed., pp. 171-222). Palo Alto, CA: Consulting Psychologists Press.
109. Wesson, M. J., & Gogus, C. I., (2005). Shaking hands with a computer: An examination of two methods of organizational newcomer orientation. Journal of Applied Psychology, 90, 1018-1026.
110. Yeo, G. B., & Neal, A., (2006). An examination of the dynamic relationship between self-efficacy and performance across levels of analysis and levels of specificity. Journal of Applied Psychology, 91, 1088-1101.