Best Practice Recommendations for Designing and Implementing Experimental Vignette Methodology Studies

Organizational Research Methods

Volumn 17, Issue 4, 2014, Pages 351-371

  Aguinis, Herman ^a   Bradley, Kyle J ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

experimental design; quasi experimental design; research design

Indexed keywords

EID: 84907550478     PISSN: 10944281     EISSN: 15527425     Source Type: Journal    
DOI: 10.1177/1094428114547952     Document Type: Article

References (92)

1. Aguinis H.,Adams S. K. R.Social-role versus structural models of gender and influence use in organizations: A strong inference approach.Group and Organization Management. 1998;23:414-446
2. Aguinis H.,Edwards J. R.Methodological wishes for the next decade and how to make wishes come true.Journal of Management Studies. 2014;51:143-174
3. Aguinis H.,Glavas A.What we know and don’t know about corporate social responsibility: A review and research agenda.Journal of Management. 2012;38:932-968
4. Aguinis H.,Gottfredson R. K.,Culpepper S. A.Best-practice recommendations for estimating cross-level interaction effects using multilevel modeling.Journal of Management. 2013;39:1490-1528
5. Aguinis H.,Kraiger K.Benefits of training and development for individuals and teams, organizations, and society.Annual Review of Psychology. 2009;60:451-474
6. Aguinis H.,Lawal S. O.Conducting field experiments using eLancing’s natural environment.Journal of Business Venturing. 2012;27:493-505
7. Aguinis H.,Lawal S. O.eLancing: A review and research agenda for bridging the science-practice gap.Human Resource Management Review. 2013;23:6-17
8. Aguinis H.,Vandenberg R. J.An ounce of prevention is worth a pound of cure: Improving research quality before data collection.Annual Review of Organizational Psychology and Organizational Behavior. 2014;1:569-595
9. Aiman-Smith L.,Scullen S. E.,Barr S. H.Conducting studies of decision making in organizational contexts: A tutorial for policy-capturing and other regression-based techniques.Organizational Research Methods. 2002;5:388-414
10. Alexander C. S.,Becker H. J.The use of vignettes in survey research.Public Opinion Quarterly. 1978;42:93-104
11. Allen D. G.,Hancock J. I.,Vardaman J. M.,McKee D. N.Analytical mindsets in turnover research.Journal of Organizational Behavior. 2014;35:61-68
12. Argyris C.Dangers in applying results from experimental social psychology.American Psychologist. 1975;30:469-485
13. Asendorpf J. B.,Conner M.,De Fruyt F.,De Houwer J.,Denissen J. J.,Fiedler K.Wicherts J. M.Recommendations for increasing replicability in psychology.European Journal of Personality. 2013;27:108-119
14. Atzmüller C.,Steiner P. M.Experimental vignette studies in survey research.Methodology: European Journal of Research Methods for the Behavioral and Social Sciences. 2010;6:128-138
15. Barney J.,Felin T.What are microfoundations?.The Academy of Management Perspectives. 2013;27:138-155
16. Bedeian A. G.,Taylor S. G.,Miller A. N.Management science on the credibility bubble: Cardinal sins and various misdemeanors.Academy of Management Learning & Education. 2010;9:715-725
17. Benjamin L.,Flynn F. J.Leadership style and regulatory mode: Value from fit?.Organizational Behavior and Human Decision Processes. 2006;100:216-230
18. Bucar B.,Glas M.,Hisrich R. D.Ethics and entrepreneurs: An international comparative study.Journal of Business Venturing. 2003;18:261-281
19. Burstin K.,Doughtie E. B.,Raphaeli A.Contrastive vignette technique: An indirect methodology designed to address reactive social attitude measurement.Journal of Applied Social Psychology. 1980;10:147-165
20. Carroll J. S.,Johnson E. J.Decision research: A field guide. Thousand Oaks, CA: Sage Publications, Inc; 1990:
21. Casper W. J.,Eby L. T.,Bordeaux C.,Lockwood A.,Lambert D.A review of research methods in IO/OB work-family research.Journal of Applied Psychology. 2007;92:28-43
22. Cavanaugh G. F.,Fritzsche D. J.Research in corporate social performance and policy. Preston L. E., ed. London: Jai Press; 1985:279-293.
23. De Cremer D.,Mayer D. M.,van Dijke M.,Schouten B. C.,Bardes M.When does self-sacrificial leadership motivate prosocial behavior? It depends on followers’ prevention focus.Journal of Applied Psychology. 2009;94:887-889
24. De Cremer D.,Van Knippenberg D.Leader self-sacrifice and leadership effectiveness: The moderating role of leader self-confidence.Organizational Behavior and Human Decision Processes. 2004;95:140-155
25. Donoho C. L.The “top-of-the-line” influence on the buyer-seller relationship.Journal of Business Research. 2003;56:303-309
26. Eastman K. K.In the eyes of the beholder: An attributional approach to ingratiation and organizational citizenship behavior.Academy of Management Journal. 1994;37:1379-1391
27. Finch J.The vignette technique in survey research.Sociology. 1987;21:105-114
28. Ganong L. H.,Coleman M.Multiple segment factorial vignette designs.Journal of Marriage and Family. 2006;68:455-468
29. Goldberg L. R.,Johnson J. A.,Eber H. W.,Hogan R.,Ashton M. C.,Cloninger C. R.,Gough H. G.The international personality item pool and the future of public-domain personality measures.Journal of Research in Personality. 2006;40:84-96
30. Goldman B. M.,Gutek B. A.,Stein J. H.,Lewis K.Employment discrimination in organizations: Antecedents and consequences.Journal of Management. 2006;32:786-830
31. Gordon M. E.,Slade L. A.,Schmitt N.The “science of the sophomore” revisited: From conjecture to empiricism.Academy of Management Review. 1986;11:191-207
32. Graham M. E.,Cable D. M.Consideration of the incomplete block design for policy-capturing research.Organizational Research Methods. 2001;4:26-45
33. Grant A. M.,Wall T. D.The neglected science and art of quasi-experimentation: Why-to, when-to, and how-to advice for organizational researchers.Organizational Research Methods. 2009;12:653-686
34. Green P. E.Hybrid models for conjoint analysis: An expository review.Journal of Marketing Research. 1984;21:155-169
35. Green P. E.,Krieger A. M.,Wind Y.Thirty years of conjoint analysis: Reflections and prospects.Interfaces. 2001;31 ((3)): S56-S73
36. Heslin P. A.,Vandewalle D.,Latham G. P.Keen to help? Managers’ implicit person theories and their subsequent employee coaching.Personnel Psychology. 2006;59:871-902
37. Highhouse S.Designing experiments that generalize.Organizational Research Methods. 2009;12:554-566
38. Hobson F. W.,Gibson C. J.Policy capturing as an approach to understanding and improving performance appraisal: a review of the literature.Academy of Management Review. 1983;8:640-649
39. Hox J. J.,Kreft I. G.,Hermkens P. L.The analysis of factorial surveys.Sociological Methods & Research. 1991;19:493-510
40. Hoyt C. L.,Price T. L.,Poatsy L.The social role theory of unethical leadership.The Leadership Quarterly. 2013;24:712-723
41. Hughes R.,Huby M.The application of vignettes in social and nursing research.Journal of Advanced Nursing. 2002;37:382-386
42. Hyman M. R.,Steiner S. DMarketing: Moving toward the 21st century. Stuart E. W.Ortinau D. J.Moore E. M., ed. Rock Hill, SC: Winthrop University School of Business; 1996:261-265.
43. Jasny B. R.,Chin G.,Chong L.,Vignieri S.Again, and again, and again ….Science. 2011;334:1225
44. Jasso G.Factorial survey methods for studying beliefs and judgments.Sociological Methods & Research. 2006;34:334-423
45. Joseph T.,Chandrasekaran K.Conjoint analysis: A perfect link between marketing and product design functions—A review.International Journal of Management Research and Development. 2013;3:8-21
46. Karren R. J.,Barringer M. W.A review and analysis of the policy-capturing methodology in organizational research: Guidelines for research and practice.Organizational Research Methods. 2002;5:337-361
47. Krasikova D.,LeBreton J. M.Just the two of us: Misalignment of theory and methods in examining dyadic phenomena.Journal of Applied Psychology. 2012;97:739-757
48. Kruschke J. K.,Aguinis H.,Joo H.The time has come: Bayesian methods for data analysis in the organizational sciences.Organizational Research Methods. 2012;15:722-752
49. Lohrke F. T.,Holloway B. B.,Woolley T. W.Conjoint analysis in entrepreneurship research a review and research agenda.Organizational Research Methods. 2010;13:16-30
50. Louviere J. J.Analyzing decision making: Metric conjoint analysis. Newbury Park, CA: Sage; 1988:
51. Ludwick R.,Zeller R. A.The factorial survey: An experimental method to replicate real world problems.Nursing Research. 2001;50:129-133
52. Matsukura H.,Yoneda T.,Ishida H.Smelling screen: Development and evaluation of an olfactory display system for presenting a virtual odor source.IEEE Transactions on Visualization and Computer Graphics. 2013;19:606-615
53. McGuire W. J.The yin and yang of progress in social psychology: Seven koan.Journal of Personality and Social Psychology. 1973;26:446-456
54. McKelvie A.,Haynie J. M.,Gustavsson V.Unpacking the uncertainty construct: Implications for entrepreneurial action.Journal of Business Venturing. 2011;26:273-292
55. McNemar Q.Opinion-attitude methodology.Psychological Bulletin. 1946;43:289-374
56. Melone N. P.Reasoning in the executive suite: The influence of role/experience-based expertise on decision processes of corporate executives.Organization Science. 1994;5:438-455
57. Miller K. D.,Tsang E. W.Testing management theories: Critical realist philosophy and research methods.Strategic Management Journal. 2011;32:139-158
58. Murphy K. R.,Herr B. M.,Lockhart M. C.,Maguire E.Evaluating the performance of paper people.Journal of Applied Psychology. 1986;71:654-661
59. Newcombe M. J.,Ashkanasy N. M.The role of affect and affective congruence in perceptions of leaders: An experimental study.The Leadership Quarterly. 2002;13:601-614
60. Pelletier K. L.Perceptions of and reactions to leader toxicity: Do leader-follower relationships and identification with victim matter?.The Leadership Quarterly. 2012;23:412-424
61. Pierce C. A.,Aguinis H.Using virtual reality technology in organizational behavior research.Journal of Organizational Behavior. 1997;18:407-410
62. Pierce C. A.,Aguinis H.,Adams S. K. R.Effects of a dissolved workplace romance and rater characteristics on responses to a sexual harassment accusation.Academy of Management Journal. 2000;43:869-880
63. Podsakoff N. P.,Podsakoff P. M.,MacKenzie S. B.,Maynes T. D.,Spoelma T. M.Consequences of unit-level organizational citizenship behaviors: A review and recommendations for future research.Journal of Organizational Behavior. 2014;35:87-119
64. Podsakoff N. P.,Whiting S. W.,Podsakoff P. M.,Mishra P.Effects of organizational citizenship behaviors on selection decisions in employment interviews.Journal of Applied Psychology. 2011;96:310-326
65. Podsakoff P. M.,Dalton D. R.Research methodology in organizational studies.Journal of Management. 1987;13:419-441
66. Podsakoff P. M.,MacKenzie S. B.,Podsakoff N. P.,Bachrach D. G.Scholarly influence in the field of management: A bibliometric analysis of the determinants of university and author impact in the management literature in the past quarter century.Journal of Management. 2008;34:641-720
67. Powell G. N.Workplace romances between senior-level executives and lower-level employees: An issue of work disruption and gender.Human Relations. 2001;54:1519-1544
68. Priem R. L.,Harrison D. A.Exploring strategic judgment: Methods for testing the assumptions of prescriptive contingency theories.Strategic Management Journal. 1994;15:311-324
69. Priem R. L.,Walters B. A.,Li S.Decisions, decisions! How judgment policy studies can integrate macro and micro domains in management research.Journal of Management. 2011;37:553-580
70. Raaijmakers A.,Vermeulen P.,Meeus M.,Zietsma C.I need time! Exploring pathways to compliance under institutional complexity.Academy of Management Journal. in press;:
71. Roehling M. V.“Extracting” policy from judicial opinions: the dangers of policy capturing in a field setting.Personnel Psychology. 1993;46:477-502
72. Roehling M. V.Weight-based discrimination in employment: Psychological and legal aspects.Personnel Psychology. 1999;52:969-1016
73. Sauer S. J.Taking the reins: The effects of new leader status and leadership style on team performance.Journal of Applied Psychology. 2011;96:574-587
74. Scandura T. A.,Williams E. A.Research methodology in management: Current practices, trends, and implications for future research.Academy of Management Journal. 2000;43:1248-1264
75. Shadish W. R.,Cook T. D.,Campbell D. T.Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin; 2002:
76. Shepherd D. A.Multilevel entrepreneurship research: Opportunities for studying entrepreneurial decision making.Journal of Management. 2011;37:412-420
77. Shepherd D. A.,Patzelt H.,Baron R. A.“I Care about Nature, but…”: Disengaging values in assessing opportunities that cause harm.Academy of Management Journal. 2013;56:1251-1273
78. Shepherd D. A.,Zacharakis A.Conjoint analysis: A new methodological approach for researching the decision policies of venture capitalists.Venture Capital: An International Journal of Entrepreneurial Finance. 1999;1:197-217
79. Shook C. L.,Ketchen D. J.,Cycyota C. S.,Crockett D.Data analytic trends and training in strategic management.Strategic Management Journal. 2003;24:1231-1237
80. Skarlicki D. P.,Turner R. A.Unfairness begets unfairness: Victim derogation bias in employee ratings.Organizational Behavior and Human Decision Processes. 2014;124:34-46
81. Slaughter J. E.,Richard E. M.,Martin J. H.Comparing the efficacy of policy-capturing weights and direct estimates for predicting job choice.Organizational Research Methods. 2006;9:285-314
82. Sniderman P. M.,Grob D. B.Innovations in experimental design in attitude surveys.Annual Review of Sociology. 1996;22:377-399
83. Spector P. E.Research designs. Newbury Park, CA: Sage; 1981:
84. Taggar S.,Neubert M.The impact of poor performers on team outcomes: An empirical examination of attribution theory.Personnel Psychology. 2004;57:935-968
85. Taylor B. J.Factorial surveys: Using vignettes to study professional judgment.British Journal of Social Work. 2006;36:1187-1207
86. Uy M. A.,Foo M. D.,Aguinis H.Using experience sampling methodology to advance entrepreneurship theory and research.Organizational Research Methods. 2010;13:31-54
87. Wason K. D.,Polonsky M. J.,Hyman M. R.Designing vignette studies in marketing.Australasian Marketing Journal. 2002;10:41-58
88. Weber J.Scenarios in business ethics research: A review, critical assessment, and recommendations.Business Ethics Quarterly. 1992;77:137-160
89. Whiting S. W.,Maynes T. D.,Podsakoff N. P.,Podsakoff P. M.Effects of message, source, and context on evaluations of employee voice behavior.Journal of Applied Psychology. 2012;97:159-182
90. Wilks T.The use of vignettes in qualitative research into social work values.Qualitative Social Work. 2004;3:78-87
91. Woehr D. J.,Lance C. E.Paper people versus direct observation: An empirical examination of laboratory methodologies.Journal of Organizational Behavior. 1991;12:387-397
92. Yun S.,Faraj S.,Sims H. P.Contingent leadership and effectiveness of trauma resuscitation teams.Journal of Applied Psychology. 2005;90:1288-1296