Organizational interventions: A research-based framework for the evaluation of both process and effects

Work and Stress

Volumn 27, Issue 3, 2013, Pages 278-297

  Nielsen, Karina ^a,c   Abildgaard, Johan Simonsen ^b  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

^c NATIONAL RESEARCH CENTRE FOR THE WORKING ENVIRONMENT   (Denmark)

Author keywords

effect evaluation; evaluation framework; organizational interventions; process evaluation

Indexed keywords

EID: 84881023367     PISSN: 02678373     EISSN: 14645335     Source Type: Journal    
DOI: 10.1080/02678373.2013.812358     Document Type: Article

References (82)

1. Anderson, D. L. 2012. Organization development: The process of leading organizational change. Thousand Oaks, CA: Sage Publications.
2. Argyris, C. 1991. Teaching smart people how to learn. Harvard Business Review, May-June, 99 - 109.
3. Argyris, C. 2004. Double-loop learning and implementable validity. In H. Tsoukas & N. Mylonopoulos, Organizations as knowledge systems: Knowledge, learning and dynamic capabilities (pp. 29 - 45). Basingstoke: Palgrave Macmillan.
4. Aust, B., & Ducki, A. 2004. Comprehensive work health promotion interventions in the workplace: Experiences with health circles in Germany. Journal of Occupational Health Psychology, 9, 258 - 270. doi: 10.1037/1076-8998.9.3.258
5. Bambra, C., Egan, M., Thomas, S., Petticrew, M., & Whitehead, M. 2007. The psychosocial and health effects of workplace reorganisation. 2. A systematic review of task restructuring interventions. Journal of Epidemiology and Community Health, 61, 1028 - 1037. doi: 10.1136/jech.2006.054999
6. Bandura, A. 1997. Self-efficacy: The exercise of control. New York, NY: Worth Publishers.
7. Biron, C., Gatrell, K., & Cooper, C. 2010. Autopsy of a failure: Evaluating process and contextual issues in an organizational-level work stress intervention. International Journal of Stress Management, 17, 135 - 158. doi: 10.1037/a0018772
8. Cook, T. R., & Campbell, D. T. 1979. Quasi-experimentation: Design and analysis issues for the field settings. Chicago, IL: Rand McNally.
9. Cook, T., & Shadish, W. R. 1994. Social experiments: Some developments over the past fifteen years. Annual Review of Psychology, 45, 545 - 580. doi: 10.1146/annurev.ps.45.020194.002553
10. Cooper, C., Dewe, P., & O'Driscoll, M. 2001. Organizational interventions. In C. Cooper, P. Dewe & M. O'Driscoll, Organizational stress: A review and critique of theory, research, and applications, 1st ed, pp. 187 - 232. Thousand Oaks, CA: Sage Publications.
11. Cox, T., Karanika, M., Griffiths, A., & Houdmont, J. 2007. Evaluating organizational-level work stress interventions: Beyond tradition methods. Work & Stress, 21, 348 - 362. doi: 10.1080/02678370701760757
12. Cox, T., Randall, R., & Griffiths, A. 2002. Interventions to control stress at work in hospital staff. Sudbury: HSE Books.
13. Cummings, T. G., & Worley, C. G. 2009. Organization development & change. Mason, OH: South-Western Cengage Learning.
14. Dahl-Jørgensen, C., & Saksvik, P. Ø. 2005. The impact of two organizational interventions on the health of service sector workers. International Journal of Health Services, 35, 529 - 549. doi: 10.2190/P67F-3U5Y-3DDW-MGT1
15. Daniels, K. 2011. Stress and well-being are still issues and something still needs to be done: Or why agency and interpretation are important for policy and practice. In G. P. Hodgkinson & J. K. Ford, Review of industrial and organizational psychology (pp. 1 - 45). Chichester: Wiley.
16. DeJoy, D. M., Wilson, M. G., Vandenberg, R. J., McGrath, A. L., & Griffin-Blake, C. S. 2010. Assessing the impact of a healthy work organization intervention. Journal of Occupational and Organizational Psychology, 83, 139 - 165. doi: 10.1348/096317908X398773
17. Egan, M., Bambra, C., Petticrew, M., & Whitehead, M. 2009. Reviewing evidence on complex social interventions: Appraising implementation in systemic reviews of the health effects of organisational-level workplace interventions. Journal of Epidemiology & Community Health, 63, 4 - 11. doi: 10.1136/jech.2007.071233
18. Egan, M., Bambra, C., Thomas, S., Petticrew, M., Whitehead, M., & Thomson, H. 2007. The psychosocial and health effects of workplace reorganisation. 1. A systematic review of organisational-level interventions that aim to increase employee control. Journal of Epidemiology & Community Health, 61, 945 - 954. doi: 10.1136/jech.2006.054965
19. ETUC 2004. Framework agreement on work-related stress. Brussels: European Trade Union Confederation.
20. EU-OSHA 2010. European agency for safety and health at work, European Survey of Enterprises on New and Emerging Risks, 2010. Retrieved from www.esener.eu
21. European Network for Workplace Health Promotion 2007. Luxembourg declaration on workplace health promotion in the European Union. Brussels: Author.
22. Grant, A. M. & Wall, T. D. 2009. The neglected science and art of quasi-experimentation: Why-to, when-to, and how-to advice for organizational researchers. Organizational Research Methods, 12, 653 - 686. doi: 10.1177/1094428108320737
23. Griffin, R. 1991. Effects of work redesign on employee perceptions, attitudes, and behaviors: A long-term investigation. Academy of Management Journal, 34, 425 - 435. doi: 10.2307/256449
24. Guastello, S. 1993. Do we really know how well our occupational accident prevention programs work? Safety Science, 16, 445 - 463. doi: 10.1016/0925-7535(93)90064-K
25. Heaney, C., Israel, B., Schurman, S., Baker, E., House, J., & Hugentobler, M. 1993. Industrial relations, worksite stress reduction, and employee well-being: A participatory action research investigation. Journal of Organizational Behavior, 14, 495 - 510. doi: 10.1002/job.4030140510
26. Hernes, T. 2008. Understanding organization as process, Theory for a tangled world. New York, NY: Routledge.
27. Hurrell, J. 2005. Organizational stress intervention. In J. Barling, E. K. Kelloway & M. R. Frone, Handbook of work stress (pp. 623 - 645). Thousand Oaks, CA: Sage.
28. Hurrell, J., & Murphy, L. 1996. Occupational stress intervention. American Journal of Industrial Medicine, 29, 338 - 341. doi: 10.1002/(SICI)1097-0274(199604)29:4<338::AID-AJIM11>3.0.CO;2-2
29. ILO 2001. Guidelines on occupational safety and health management systems. Geneva: International Labor Office.
30. Johns, G. 2006. The essential impact of context on organizational behavior. Academy of Management Review, 31, 386 - 408. doi: 10.5465/AMR.2006.20208687
31. Johnson-Laird, P. N. 1983. Mental models: Towards a cognitive science of language, inference and consciousness. Cambridge: Cambridge University Press.
32. Katz, D., & Kahn, R. L. 1978. The social psychology of organizations. New York, NY: Wiley.
33. Kompier, M., Cooper, C., & Geurts, S. 2000. A multiple case study approach to work stress prevention in Europe. European Journal of Work and Organizational Psychology, 9, 371 - 400. doi: 10.1080/135943200417975
34. Kompier, M., Geurts, S., Grundemann, R., Vink, P., & Smulders, P. 1998. Cases in stress prevention: The success of a participative and stepwise approach. Stress Medicine, 14, 155 - 168. doi: 10.1002/(SICI)1099-1700(199807)14:3<155::AID-SMI773>3.0.CO;2-C
35. Landsbergis, P., & Vivona-Vaughan, E. 1995. Evaluation of an occupational stress intervention in a public agency. Journal of Organizational Behavior, 16, 29 - 48. doi: 10.1002/job.4030160106
36. Lazarus, R., & Folkman, S. 1984. Stress, appraisal and coping. New York, NY: Springer Publications.
37. Lindquist, T. L., & Cooper, C. L. 1999. Using life style and coping to reduce job stress and improve health in "at risk" office workers. Stress Medicine, 15, 143 - 152. doi: 10.1002/(SICI)1099-1700(199907)15:3<143::AID-SMI808>3.0.CO;2-4
38. Lipsey, M. 1996. Key issues in intervention research: A program evaluation perspective. American Journal of Industrial Medicine, 29, 298 - 302. doi: 10.1002/(SICI)1097-0274(199604)29:4<298::AID-AJIM4>3.0.CO;2-L
39. Mattila, P., Elo, A.-L., Kuosma, E., & Kylä-Setälä, E. 2006. Effect of a participative work conference on psychosocial work environment and well-being. European Journal of Work and Organizational Psychology, 15, 459 - 476. doi: 10.1080/13594320600901729
40. Mikkelsen, A., & Saksvik, P. Ø. 1998. Learning from parallel organizational development efforts in two public sector settings. Review of Public Personnel Administration, 2, 5 - 22. doi: 10.1177/0734371X9801800202
41. Mikkelsen, A., & Saksvik, P. Ø. 1999. Impact of a participatory organizational intervention on job characteristics and job stress. International Journal of Health Services, 29, 871 - 893. doi: 10.2190/KLPQ-FTH3-WHH5-PPP1
42. Mikkelsen, A., Saksvik, P. Ø., & Landsbergis, P. 2000. The impact of a participatory organizational intervention on job stress in community health care institutions. Work & Stress, 14, 156 - 170. doi: 10.1080/026783700750051667
43. Murta, S. G., Sanderson, K., & Oldenburg, B. 2007. Process evaluation in occupational stress management programs: A systematic review. American Journal of Health Promotion, 21, 248 - 254. doi: 10.4278/0890-1171-21.4.248
44. Nielsen, K. 2013. Review article: How can we make organizational interventions work? Employees and line managers as actively crafting interventions. Human Relations. doi: 10.1177/001872671347716.
45. Nielsen, K., & Abildgaard, J. S. 2012. The development and validation of a job crafting measure for use with blue-collar workers. Work & Stress, 26, 365 - 384. doi: 10.1080/02678373.2012.733543
46. Nielsen, K., & Daniels, K. 2012. Enhancing team leaders' well-being states and challenge experiences during organizational change: A randomized controlled study. Human Relations, 65, 1207 - 1231. doi: 10.1177/0018726711433312
47. Nielsen, K., Fredslund, H., Christensen, K. B., & Albertsen, K. 2006. Success or failure? Interpreting and understanding the impact of interventions in four similar worksites. Work & Stress, 20, 272 - 287. doi: 10.1080/02678370601022688
48. Nielsen, K., & Randall, R. 2009. Managers' active support when implementing teams: The impact on employee well-being. Applied Psychology: Health and Well-being, 1, 374 - 390. doi: 10.1111/j.1758-0854.2009.01016.x
49. Nielsen, K., & Randall, R. 2012a. Opening the black box: A framework for evaluating organizational-level occupational health interventions. European Journal of Work & Organizational Psychology. doi: 10.1080/1359432X.2012.690556.
50. Nielsen, K., & Randall, R. 2012b. The importance of employee participation and perception of changes in procedures in a teamworking intervention. Work & Stress, 29, 91 - 111.
51. Nielsen, K., Randall, R., & Albertsen, K. 2007. Participants' appraisals of process issues and the effects of stress management interventions. Journal of Organizational Behavior, 28, 793 - 810. doi: 10.1002/job.450
52. Nielsen, K., Randall, R., & Christensen, K. B. 2010a. Does training managers enhance the effects of implementing teamworking? A longitudinal, mixed methods field study. Human Relations, 11, 1719 - 1741.
53. Nielsen, K., Randall, R., & Christensen, K. B. 2010b. Developing new ways of evaluating organizational-level interventions. In J. Houdmont & S. Leka, Contemporary occupational health psychology: Global perspectives on research and practice (pp. 21 - 44). Chichester: Wiley-Blackwell.
54. Nielsen, K., Randall, R., Holten, A. L., & Rial González, E. 2010c. Conducting organizational-level occupational health interventions: What works? Work & Stress, 24, 234 - 259. doi: 10.1080/02678373.2010.515393
55. Nielsen, K., Taris, T. W., & Cox, T. 2010d. The future of organizational interventions: Addressing the challenges of today's organizations. Work & Stress, 24, 219 - 233. doi: 10.1080/02678373.2010.519176
56. Nytrø, K., Saksvik, P. Ø., Mikkelsen, A., Bohle, P., & Quinlan, M. 2000. An appraisal of key factors in the implementation of occupational stress interventions. Work & Stress, 14, 213 - 225. doi: 10.1080/02678370010024749
57. Øyum, L., Kvernberg Andersen, T., Pettersen Buvik, M., Knutstad, G. A., & Skarholt, K. 2006. God ledelsespraksis i endringsprocesser: Eksempler på hvordan ledere har gjort til en positiv erfaring for de ansatte [Good management practices during change processes: Examples of how managers have made change a positive experience for employees] (Rep. No. 567). København: Nordisk Ministerråd.
58. Pawson, R. 2006. Evidence-based policy: A realist perspective. Thousand Oaks, CA: Sage.
59. Pawson, R., & Tilley, N. 1997. Realistic evaluation. London: Sage.
60. Pettigrew, A. M. 1990. Longitudinal field research on change: Theory and practice. Organization Science, 1, 267 - 292. doi: 10.1287/orsc.1.3.267
61. Pillai, R., & Williams, E. 2004. Transformational leadership, self-efficacy, group cohesiveness, commitment, and performance. Journal of Organizational Change Management, 17, 144 - 159. doi: 10.1108/09534810410530584
62. Randall, R., Cox, T., & Griffiths, A. 2007. Participants' accounts of a stress management intervention. Human Relations, 60, 1181 - 1209. doi: 10.1177/0018726707081660
63. Randall, R., Griffiths, A., & Cox, T. 2005. Evaluating organizational stress-management interventions using adapted study designs. European Journal of Work and Organizational Psychology, 14, 23 - 41. doi: 10.1080/13594320444000209
64. Randall, R., & Nielsen, K. 2010. Interventions to promote well-being at work. In S. Leka & J. Houdmont, Occupational health psychology, 1st ed., pp. 88 - 123. Chichester: Wiley-Blackwell.
65. Richardson, K. M., & Rothstein, H. R. 2008. Effects of occupational stress management intervention programs: A meta-analysis. Journal of Occupational Health Psychology, 13, 69 - 93. doi: 10.1037/1076-8998.13.1.69
66. Rossi, P. H., Lipsey, R. W., & Freeman, H. E. 2004. Evaluation: A systematic approach. London: Sage.
67. Rosskam, E. 2009. Using participatory action research methodology to improve worker health. In P. Schnall, M. Dobson & E. Rosskam, Unhealthy work: Causes, consequences, cures (pp. 211 - 229). Amityville, NY: Baywood Publishing Company.
68. Saksvik, P. Ø., Nytrø, K., Dahl-Jørgensen, C., & Mikkelsen, A. 2002. A process evaluation of individual and organizational occupational stress and health interventions. Work & Stress, 16, 37 - 57. doi: 10.1080/02678370110118744
69. Schurman, S., & Israel, B. 1995. Redesigning work systems to reduce stress: A participatory action research approach to creating change. In L. Murphy, J. Hurrell, S. Sauter & G. Keita, Job stress interventions (pp. 235 - 263). Washington, DC: APA.
70. Semmer, N. K. 2011. Job stress interventions and organization of work. In J. C. Quick & L. E. Tetrick, Handbook of occupational health psychology, 2nd ed., pp. 299 - 318. Washington, DC: APA.
71. Shannon, H., Robson, L., & Guastello, S. 1999. Methodological criteria for evaluating occupational safety intervention research. Safety Science, 31, 161 - 179. doi: 10.1016/S0925-7535(98)00063-0
72. Steckler, A. B., & Linnan, L. 2002. Process evaluation for public health interventions and research. San Francisco, CA: Jossey-Bass.
73. Stengers, I. 2011. Thinking with Whitehead: A Free and wild creation of concepts. (M. Chase, Trans.). Cambridge, MA: Harvard University Press.
74. Taris, T. W., & Kompier, M. 2003. Challenges in longitudinal designs in occupational health psychology. Scandinavian Journal of Work, Environment and Health, 29, 1 - 4. doi: 10.5271/sjweh.697
75. Taris, T. W., & Schreurs, P. J. G. 2009. Well-being and organizational performance: An organizational-level test of the happy-productive worker hypothesis. Work & Stress, 23, 120 - 136. doi: 10.1080/02678370903072555
76. Theorell, T., Orth-Gomér, K., Moser, V., Undén, A.-L., & Eriksson, I. 1995. Endocrine markers during a job intervention. Work & Stress, 9, 67 - 76. doi: 10.1080/02678379508251586
77. Tsoukas, H., & Chia, R. 2002. On organizational becoming: Rethinking organizational change. Organization Science, 13, 567 - 582.
78. Vedung, E. 2006. Process evaluation and implementation theory. In E. Vedung, Public policy and program evaluation, 1st ed., pp. 209 - 245. Piscataway, NJ: Transaction Publishers.
79. Weick, K. E. 1979. The social psychology of organizing, (2nd ed.). Reading, MA: Addison-Wesley.
80. Weick, K. E., Sutcliffe, K. M., & Obstfeld, D. 2005. Organizing and the process of sensemaking. Organization Science, 16, 409 - 421.
81. Wells, R., Norman, R., Frazer, M., & Laing, A. 2001. University of Waterloo ergonomics program implementation blueprint. Retrieved from http://www.ergonomics.uwaterloo.ca/bprint.html
82. Yin, R. K. 1994. Case study research: Design and methods, 2nd ed. Thousand Oaks, CA: Sage Publications.