A methodological study to compare survey-based and observation-based evaluations of organisational and safety cultures and then compare both approaches with markers of the quality of care

Health Technology Assessment

Volumn 16, Issue 25, 2012, Pages 1-183

  Freeth, D ^a,b   Sandall, J ^c   Allan, T ^d   Warburton, F ^e   Berridge, E J ^d   Mackintosh, N ^e   Rogers, M ^d   Abbott, S ^d  

^a Centre for Medical Education   (United Kingdom)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^c KING'S COLLEGE LONDON   (United Kingdom)

^d CITY UNIVERSITY   (United Kingdom)

^e KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CORRELATIONAL STUDY; EVIDENCE BASED PRACTICE; FEASIBILITY STUDY; HEALTH CARE ORGANIZATION; HEALTH CARE QUALITY; HEALTH CARE SURVEY; HUMAN; INSTRUMENT VALIDATION; INTERMETHOD COMPARISON; METHODOLOGY; NON PARTICIPANT OBSERVATION; NONRESPONSE BIAS; OBSERVATIONAL METHOD; OBSERVER BIAS; ORGANIZATIONAL CLIMATE; PATIENT SAFETY; QUESTIONNAIRE; RETROSPECTIVE STUDY; SCORING SYSTEM; SOCIAL DESIRABILITY; TEAMWORK;

ADOLESCENT; ADULT; AGED; ANTHROPOLOGY, CULTURAL; CHI-SQUARE DISTRIBUTION; FEMALE; GREAT BRITAIN; HEALTH SURVEYS; HUMANS; MALE; MIDDLE AGED; ORGANIZATIONAL CULTURE; OUTCOME ASSESSMENT (HEALTH CARE); PSYCHOMETRICS; QUALITY OF HEALTH CARE; QUESTIONNAIRES; SAFETY; SELF-ASSESSMENT; STATE MEDICINE; STATISTICS AS TOPIC; YOUNG ADULT;

EID: 84862614059     PISSN: 13665278     EISSN: 20464924     Source Type: Journal    
DOI: 10.3310/hta16250     Document Type: Article

References (235)

1. Lilford R. The English Patient Safety Research Programme: a commissioner's tale. J Health Serv Res Policy 2010;15(Suppl. 1):1-3.
2. Department of Health. An organisation with a memory: report of an expert group on learning from adverse events in the NHS. London: Stationery Office; 2000.
3. Department of Health. Building a safer NHS for patients: implementing an organisation with a memory. London: Department of Health; 2001.
4. Department of Health. Safety first: a report for patients, clinicians and healthcare managers. London: Department of Health; 2006.
5. National Audit Office. A safer place for patients: learning to improve patient safety. London: Department of Health; 2005.
6. Patient Safety Research Portfolio (PSRP). Birmingham: University of Birmingham. URL: www.haps2.bham.ac.uk/publichealth/psrp/ (accessed June 2011).
7. Benn J, Burnett S, Parand A, Pinto A, Iskander S, Vincent C. Studying large-scale programmes to improve patient safety in whole care systems: challenges for research. Soc Sci Med 2009;69:1767-76.
8. Leape LL, Brennan TA, Laird N, Lawthers AG, Localio AR, Barnes BA, et al. The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. N Engl J Med 1991;324:377-84.
9. Bates DW, Cullen DJ, Laird N, Petersen LA, Small SD, Servi D, et al. Incidence of adverse drug events and potential adverse drug events. JAMA 1995;274:29-34.
10. Kohn LT, Corrigan J, Donaldson MS. To err is human: building a safer health system. Washington, DC: National Academies Press; 2000.
11. Burke CS, Salas E, Wilson-Donnelly K, Priest H. How to turn a team of experts into an expert medical team: guidance from the aviation and military communities. Qual Saf Health Care 2004;13(Suppl. 1):i96-104.
12. Flin R, Maran N. Identifying and training non-technical skills for teams in acute medicine. Qual Saf Health Care 2004;13(Suppl. 1):i80-4.
13. Vickers R. Training in human factor skills: lessons from aviation. Clin Risk 2009;15:8-10.
14. Singer SJ, Rosen A, Zhao S, Ciavarelli AP, Gaba DM. Comparing safety climate in naval aviation and hospitals: Implications for improving patient safety. Health Care Manag Rev 2010;35:134-46.
15. World Health Organization. Patient safety research. Geneva: World Health Organization, 2011. URL: www.who.int/patientsafety/research/en/ (accessed June 2011).
16. Mannion R, Davies HTO, Marshall M. Cultures for performance in health care. Maidenhead: Open University Press; 2005.
17. Cooper M. Towards a model of safety culture. Safety Sci 2000;36:111-36.
18. Davies HT, Nutley SM, Mannion R. Organisational culture and quality of health care. Qual Health Care 2000;9:111-19.
19. Pronovost PJ, Weast B, Holzmueller CG, Rosenstein BJ, Kidwell RP, Haller KB, et al. Evaluation of the culture of safety: survey of clinicians and managers in an academic medical center. Qual Saf Health Care 2003;12:405-10.
20. Singer SJ, Gaba DM, Geppert JJ, Sinaiko AD, Howard SK, Park KC. The culture of safety: results of an organization-wide survey in 15 California hospitals. Qual Saf Health Care 2003;12:112-18.
21. Flin R, Burns C, Mearns K, Yule S, Robertson EM. Measuring safety climate in health care. Qual Saf Health Care 2006;15:109-15.
22. National Reporting and Learning Service. Patient safety resources. London: National Patient Safety Agency. URL: www.nrls.npsa.nhs.uk/resources/ (accessed June 2011).
23. Patient Safety First Campaign. London. URL: www.patientsafetyfirst.nhs.uk (accessed June 2011).
24. Sexton J, Thomas E, Helmreich RL, Neilands TB, Rowan K, Vella K, et al. Frontline assessments of healthcare culture: Safety Attitudes Questionnaire norms and psychometric properties. Technical report. Austin, TX: The University of Texas Centre of Excellence for Patient Safety; 2004.
25. Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res 2006;6:44.
26. King M, Bruner G. Social desirability bias: a neglected aspect of validity testing. Psychol Market 2000;17:79-103.
27. Ovretveit J. Understanding and improving patient safety: the psychological, social and cultural dimensions. J Health Organ Manag 2009;23:581-96.
28. Oppenheim AN. Questionnaire design, interviewing and attitude measurement. London: Continuum; 2000.
29. Barclay S, Todd C, Finlay I, Grande G, Wyatt P. Not another questionnaire! Maximizing the response rate, predicting non-response and assessing non-response bias in postal questionnaire studies of GPs. Fam Pract 2002;19:105-11.
30. Cook JV, Dickinson HO, Eccles MP. Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study. BMC Health Serv Res 2009;9:160.
31. Dixon-Woods M. Why is patient safety so hard? A selective review of ethnographic studies. J Health Serv Res Policy 2010;15(Suppl. 1):11-16.
32. Healthcare Commission. Manual of clinical governance review/inspection practices. 4th (web) edn. London: Healthcare Commission, 2004. URL: www.healthcarecommission.org.uk/_db/_documents/04008515.pdf (accessed June 2006).
33. Catchpole KR, de Leval MR, McEwan A, Pigott N, Elliott MJ, McQuillan A, et al. Patient handover from surgery to intensive care: using Formula 1 pit-stop and aviation models to improve safety and quality. Paediatr Anaesth 2007;17:470-8.
34. Mackintosh N, Berridge EJ, Freeth D. Supporting structures for team situation awareness and decision making: insights from four delivery suites. J Eval Clin Pract 2009;15:46-54.
35. Scott T, Mannion R, Marshall M, Davies H. Does organisational culture influence health care performance? A review of the evidence. J Health Serv Res Policy 2003;8:105-17.
36. Sheaff R. Organisational factors and performance: a review of the literature: report for NHS service delivery and organisation research & development programme: programme of research on organisational form and function. London: NCCSDO; 2004.
37. Singer S, Lin S, Falwell A, Gaba D, Baker L. Relationship of safety climate and safety performance in hospitals. Health Serv Res 2009;44:399-421.
38. Silva S, Lima ML, Baptista C. OSCI: an organisational and safety climate inventory. Safety Sci 2004;42:205-20.
39. Department of Health. Reforming emergency care. London: Department of Health, 2001. URL: www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPoli cyandGuidance/DH_4008702 (accessed October 2010).
40. Department of Health. Transforming emergency care in England. London: Department of Health, 2004. URL: www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPoli cyandGuidance/DH_4091775 (accessed October 2010).
41. Department of Health. National Service Framework for children, young people & maternity services: maternity services. London: Department of Health, 2004. URL: www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPoli cyandGuidance/DH_4089101 (accessed October 2010).
42. National Patient Safety Agency. Business plan 2004-05. London: National Patient Safety Agency; 2004.
43. National Patient Safety Agency. Understanding the patient safety issues for some groups of vulnerable women knon to be at higher risk of maternal death or morbidity. London: National Patient Safety Agency; 2005.
44. Hall KK, Schenkel SM, Hirshon JM, Xiao Y, Noskin GA. Incidence and types of non-ideal care events in an emergency department. Qual Saf Health Care 2010;19(Suppl. 3):i20-5.
45. Woloshynowych M, Davis R R B, Wears R, Vincent C. Enhancing safety in A&E care. London: Imperial College, Clinical Safety Research Unit; 2006.
46. Wears RL, Woloshynowych M, Brown R, Vincent CA. Reflective analysis of safety research in the hospital accident & emergency departments. Appl Ergon 2010;41:695-700.
47. Ballard GM. Nuclear safety after Three Mile Island and Chernobyl. New York, NY: Elsevier Applied Science; 1988.
48. Vaughan D. The Challenger launch decision: risky technology, culture, and deviance at NASA. Chicago, IL: University of Chicago Press; 1996.
49. Silbey SS. Taming Prometheus: talk about safety and culture. Annu Rev Sociol 2009;35:341-69.
50. Vincent C, Neale G, Woloshynowych M. Adverse events in British hospitals: preliminary retrospective record review. BMJ 2001;322:517-19.
51. Davis P, Lay-Yee R, Briant R, Ali W, Scott A, Schug S. Adverse events in New Zealand public hospitals. I. Occurrence and impact. N Z Med J 2002;115:U271.
52. Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ 2004;170:1678-86.
53. Donaldson LJ, Gray JA. Clinical governance: a quality duty for health organisations. Qual Health Care 1998;7(Suppl.):37-44.
54. Kennedy I. The inquiry into the management of care of children receiving complex heart surgery at the Bristol Royal Infirmary. London: Department of Health; 2001.
55. Nieva VF, Sorra J. Safety culture assessment: a tool for improving patient safety in healthcare organizations. Qual Saf Health Care 2003;12(Suppl. 2):ii17-23.
56. Vincent C, Taylor-Adams S, Stanhope N. Framework for analysing risk and safety in clinical medicine. BMJ 1998;316:1154-7.
57. Reason JT, Carthey J, de Leval MR. Diagnosing 'vulnerable system syndrome': an essential prerequisite to effective risk management. Qual Health Care 2001;10(Suppl. 2):ii21-5.
58. Hann M, Bower P, Campbell S, Marshall M, Reeves D. The association between culture, climate and quality of care in primary health care teams. Fam Pract 2007;24:323-9.
59. Singer SJ, Falwell A, Gaba DM, Meterko M, Rosen A, Hartmann CW, et al. Identifying organizational cultures that promote patient safety. Health Care Manag Rev 2009;34:300-11.
60. Langfield-Smith K. Organisational culture and control. In Berry AJ, Broadbent J, Otley DT, editors. Management control: theories, issues and practices. Basingstoke: Macmillan; 1995.
61. Mannion R, Konteh FH, Davies HT. Assessing organisational culture for quality and safety improvement: a national survey of tools and tool use. Qual Saf Health Care 2009;18:153-6.
62. Hammersley M, Atkinson P. Ethnography: principles in practice. 3rd edn. London: Routledge; 2007.
63. Scott T, Mannion R, Davies H, Marshall M. The quantitative measurement of organizational culture in health care: a review of the available instruments. Health Serv Res 2003;38:923-45.
64. Pidgeon NF. Safety culture and risk management in organizations. J Cross-Cult Psychol 1991;22:129-40.
65. Wakefield JG, McLaws ML, Whitby M, Patton L. Patient safety culture: factors that influence clinician involvement in patient safety behaviours. Qual Saf Health Care 2010;19:585-91.
66. Helmreich RL. On error management: lessons from aviation. BMJ 2000;320:781-5.
67. Page A. Keeping patients safe: transforming the work environment of nurses. Washington, DC: National Academies Press; 2004.
68. National Health Service Confederation. Creating the virtuous circle: patient safety, accountability and an open and fair culture. London: National Health Service Confederation; 2003.
69. Firth-Cozens J, Mowbray D. Leadership and the quality of care. Qual Health Care 2001;10(Suppl. 2):ii3-7.
70. Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care 2004;13(Suppl. 1):i85-90.
71. Boreham N. A theory of collective competence: challenging the neo-liberal individualisation of performance at work. Br J Educ Stud 2004;52:5-17.
72. Baker DP, Day R, Salas E. Teamwork as an essential component of high-reliability organizations. Health Serv Res 2006;41:1576-98.
73. Weaver SJ, Rosen MA, DiazGranados D, Lazzara EH, Lyons R, Salas E, et al. Does teamwork improve performance in the operating room? A multilevel evaluation. Jt Comm J Qual Patient Saf 2010;36:133-42.
74. Wright MC, Taekman JM, Endsley MR. Objective measures of situation awareness in a simulated medical environment. Qual Saf Health Care 2004;13(Suppl. 1):i65-71.
75. Miller K, Riley W, Davis S. Identifying key nursing and team behaviours to achieve high reliability. J Nurs Manag 2009;17:247-55.
76. Speroff T, Nwosu S, Greevy R, Weinger MB, Talbot TR, Wall RJ, et al. Organisational culture: variation across hospitals and connection to patient safety climate. Qual Saf Health Care 2010;19:592-6.
77. Boreham NC, Shea CE, Mackway-Jones K. Clinical risk and collective competence in the hospital emergency department in the UK. Soc Sci Med 2000;51:83-91.
78. Armstrong K, Laschinger H, Wong C. Workplace empowerment and magnet hospital characteristics as predictors of patient safety climate. J Nurs Care Qual 2009;24:55-62.
79. Coyle IR, Sleeman SD, Adams N. Safety climate. J Saf Res 1995;26:247-54.
80. Elfering A, Semmer NK, Grebner S. Work stress and patient safety: observer-rated work stressors as predictors of characteristics of safety-related events reported by young nurses. Ergonomics 2006;49:457-69.
81. Halbesleben JR, Wakefield BJ, Wakefield DS, Cooper LB. Nurse burnout and patient safety outcomes: nurse safety perception versus reporting behavior. West J Nurs Res 2008;30:560-77.
82. Parker D, Lawrie M, Carthey J, Coultous M. The Manchester Patient Safety Framework: sharing the learning. Clinical Risk 2008;14:140-2.
83. Parker D. Managing risk in healthcare: understanding your safety culture using the Manchester Patient Safety Framework (MaPSaF). J Nurs Manag 2009;17:218-22.
84. National Patient Safety Agency. Manchester Patient Safety Framework (MaPSaF). London: National Patient Safety Agency; 2006.
85. Harrison R. Understanding your organization's character. Harv Bus Rev 1972;50:119-28.
86. Litwinenko A, Cooper CL. The impact of trust status on corporate culture. J Manag Med 1994;8:8-17.
87. Quinn RE, Rohrbaugh J. A spatial model of effectiveness criteria - towards a competing values approach to organizational analysis. Manag Sci 1983;29:363-77.
88. Cameron KS, Quinn RE. Diagnosing and changing organizational culture: based on the competing values framework. Reading, MA: Addison-Wesley; 1998.
89. Cameron K, Freeman S. Culture, congruence, strength and type: relationship to effectiveness. Res Organiz Change Develop 1991;5:23-58.
90. Gerowitz MB, Lemieux-Charles L, Heginbothan C, Johnson B. Top management culture and performance in Canadian, UK and US hospitals. Health Serv Manag Res 1996;9:69-78.
91. Cooke R, Lafferty J. Organizational Culture Inventory (OCI). Plymouth, MI: Human Synergistics; 1987.
92. Thomas C, Ward M, Chorba C, Kumiega A. Measuring and interpreting organizational culture. J Nurs Admin 1990;20:17-24.
93. Ingersoll GL, Kirsch JC, Merk SE, Lightfoot J. Relationship of organizational culture and readiness for change to employee commitment to the organization. J Nurs Admin 2000;30:11-20.
94. Shortell SM, Zazzali JL, Burns LR, Alexander JA, Gillies RR, Budetti PP, et al. Implementing evidence-based medicine: the role of market pressures, compensation incentives, and culture in physician organizations. Med Care 2001;39(Suppl. 1):I62-78.
95. Pronovost P, Sexton B. Assessing safety culture: guidelines and recommendations. Qual Saf Health Care 2005;14:231-3.
96. Kho ME, Carbone JM, Lucas J, Cook DJ. Safety Climate Survey: reliability of results from a multicenter ICU survey. Qual Saf Health Care 2005;14:273-8.
97. Shtyenberg G, Sexton J, Thomas E. Test retest reliability of the safety climate scale. Technical Report 01-05. Austin: University of Texas Centre of Excellence for Patient Safety Research and Practice, 2006. URL: www.utpatientsafety.org.
98. Waterson P, Griffiths P, Stride C, Murphy J, Hignett S. Psychometric properties of the Hospital Survey on Patient Safety Culture: findings from the UK. Qual Saf Health Care 2010;19:e2.
99. Blegen MA, Gearhart S, O'Brien R, Sehgal NL, Alldredge BK. AHRQ's hospital survey on patient safety culture: psychometric analyses. J Patient Saf 2009;5:139-44.
100. Sarac C, Flin R, Mearns K, Jackson J. Hospital survey on patient safety culture: psychometric analysis on a Scottish sample. BMJ Qual Saf 2011;20:842-8.
101. Helmreich RL, Schaefer H. Team performance in the operating room. In Bogner M, editor. Human error in medicine. Hillsdale, NJ: Lawrence Erlbaum Associates; 1994: pp. 225-53.
102. Hartmann CW, Rosen AK, Meterko M, Shokeen P, Zhao S, Singer S, et al. An overview of patient safety climate in the VA. Health Serv Res 2008;43:1263-84.
103. Hartmann CW, Meterko M, Rosen AK, Shibei Zhao, Shokeen P, Singer S, et al. Relationship of hospital organizational culture to patient safety climate in the Veterans Health Administration. Med Care Res Rev 2009;66:320-38.
104. Singer S, Meterko M, Baker L, Gaba D, Falwell A, Rosen A. Workforce perceptions of hospital safety culture: development and validation of the patient safety climate in healthcare organizations survey. Health Serv Res 2007;42:1999-2021.
105. Singer SJ, Hartmann CW, Hanchate A, Zhao S, Meterko M, Shokeen P, et al. Comparing safety climate between two populations of hospitals in the United States. Health Serv Res 2009;44:1563-83.
106. Singer SJ, Gaba DM, Falwell A, Lin S, Hayes J, Baker L. Patient safety climate in 92 US hospitals: differences by work area and discipline. Med Care 2009;47:23-31.
107. Gershon R, Karkashian, Grosch J, Murphy L, Escamilla-Cejudo A, Flanagan P, et al. Hospital safety climate and its relationship with safe work practices and workplace exposure incidents. Am J Infect Control 2000;28:211-21.
108. Turnberg W, Daniell W. Evaluation of a healthcare safety climate measurement tool. J Safety Res 2008;39:563-8.
109. Westrum R. A typology of organisational cultures. Qual Saf Health Care 2004;13(Suppl. 2):ii22-7.
110. National Patient Safety Agency. Seven steps to patient safety. London: National Patient Safety Agency; 2003.
111. National Patient Safety Agency. Team Climate Assessment Measure (TCAM) Programme. London: National Patient Safety Agency, 2006. URL: www.nrls.npsa.nhs.uk/resources/?entryid45=59884 (accessed June 2011).
112. Michie S, West MA. Managing people and performance: an evidence based framework applied to health service organizations. Int J Manag Rev 2004;5-6:91-111.
113. Ginsburg L, Gilin D, Tregunno D, Norton PG, Flemons W, Fleming M. Advancing measurement of patient safety culture. Health Serv Res 2009;44:205-24.
114. Milne JK, Bendaly N, Bendaly L, Worsley J, Fitzgerald J, Nisker J. A measurement tool to assess culture change regarding patient safety in hospital obstetrical units. J Obstet Gynaecol Can 2010;32:590-7.
115. Olsen E. Exploring the possibility of a common structural model measuring associations between safety climate factors and safety behaviour in health care and the petroleum sectors. Accid Anal Prev 2010;42:1507-16.
116. Currie L, Watterson L. Measuring the safety climate in NHS organisations. Nurs Stand 2010;24:35-8.
117. de Wet C, Spence W, Mash R, Johnson P, Bowie P. The development and psychometric evaluation of a safety climate measure for primary care. Qual Saf Health Care 2010;19:578-84.
118. Lingard L, Espin S, Whyte S, Regehr G, Baker GR, Reznick R, et al. Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Saf Health Care 2004;13:330-4.
119. Cole E, Crichton N. The culture of a trauma team in relation to human factors. J Clin Nurs 2006;15:1257-66.
120. Catchpole KR, Giddings AE, de Leval MR, Peek GJ, Godden PJ, Utley M, et al. Identification of systems failures in successful paediatric cardiac surgery. Ergonomics 2006;49:567-88.
121. McDonald R, Waring J, Harrison S. At the cutting edge? Modernization and nostalgia in a hospital operating theatre department. Sociology 2006;40:1097-115.
122. Waring J. Adaptive regulation or governmentality: patient safety and the changing regulation of medicine. Sociol Health Illness 2007;29:163-79.
123. Waring JJ. Doctors' thinking about 'the system' as a threat to patient safety. Health (London) 2007;11:29-46.
124. Waring J, Harrison S, McDonald R. A culture of safety or coping? Ritualistic behaviours in the operating theatre. J Health Serv Res Policy 2007;12(Suppl. 1):1-3-9.
125. Dixon-Woods M, Suokas A, Pitchforth E, Tarrant C. An ethnographic study of classifying and accounting for risk at the sharp end of medical wards. Soc Sci Med 2009;69:362-9.
126. Robson C. Real world research: a resource for users of social research methods in applied settings. 3rd edn. Oxford: Wiley-Blackwell; 2011.
127. Smith V. Ethnographies of work and the work of ethnographers. In: Atkinson P, editor. Handbook of Ethnography. London: Sage, 2001; pp. 220-33.
128. Willis EM. The problem of time in ethnographic health care research. Qual Health Res 2010;20:556-64.
129. Fitzpatrick JM, While AE, Roberts JD. Shift work and its impact upon nurse performance: current knowledge and research issues. J Adv Nurs 1999;29:18-27.
130. Pound P, Sabin C, Ebrahim S. Observing the process of care: a stroke unit, elderly care unit and general medical ward compared. Age Ageing 1999;28:433-40.
131. Booth J, Davidson I, Winstanley J, Waters K. Observing washing and dressing of stroke patients: nursing intervention compared with occupational therapists. What is the difference? J Adv Nurs 2001;33:98-105.
132. Berridge EJ, Mackintosh NJ, Freeth DS. Supporting patient safety: examining communication within delivery suite teams through contrasting approaches to research observation. Midwifery 2010;26:512-19.
133. Spradley JP. Participant observation. New York, NY: Holt, Rinehart and Winston; 1980.
134. Hammersley M. Reading ethnographic research: a critical guide. 2nd edn. New York, NY: Longman; 1998. pp. 13-34.
135. Holy L. Theory, methodology and the research process. In Ellen R, editor. Ethnographic research: a guide to general conduct. London: Academic Press; 1984.
136. Griffin MA, Neal A. Perceptions of safety at work: a framework for linking safety climate to safety performance, knowledge, and motivation. J Occup Health Psychol 2000;5:347-58.
137. Huang DT, Clermont G, Sexton JB, Karlo CA, Miller RG, Weissfeld LA, et al. Perceptions of safety culture vary across the intensive care units of a single institution. Crit Care Med 2007;35:165-76.
138. Halligan M, Zecevic A. Safety culture in healthcare: a review of concepts, dimensions, measures and progress. Qual Saf Health Care 2011. doi:10.1136/bmjqs.2010.040964
139. Gaba D, Singer S, Rosen A. 2007. Safety culture: is the 'unit' the right 'unit of analysis'? Crit Care Med 2007;35:314-16.
140. Colla JB, Bracken AC, Kinney LM, Weeks WB. Measuring patient safety climate: a review of surveys. Qual Saf Health Care 2005;14:364-6.
141. Mohr JJ, Batalden PB. Improving safety on the front lines: the role of clinical microsystems. Qual Saf Health Care 2002;11:45-50.
142. Zohar D, Luria G. A multilevel model of safety climate: cross-level relationships between organization and group-level climates. J Appl Psychol 2005;90:616-28.
143. Smits M, Wagner C, Spreeuwenberg P, van der Wal G, Groenewegen PP. Measuring patient safety culture: an assessment of the clustering of responses at unit level and hospital level. Qual Saf Health Care 2009;18:292-6.
144. Waring J, McDonald R, Harrison S. Safety and complexity: inter-departmental relationships as a threat to patient safety in the operating department. J Health Organ Manag 2006;20:227-42.
145. Lilford RJ, Brown CA, Nicholl J. Use of process measures to monitor the quality of clinical practice. BMJ 2007;335:648-50.
146. Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, et al. Incidence of adverse events and negligence in hospitalized patients: results of the Harvard Medical Practice Study I. 1991. Qual Saf Health Care 2004;13:145-51; discussion 51-2.
147. Hutchinson A, McIntosh A, Anderson J, Gilbert C, Field R. Developing primary care review criteria from evidence-based guidelines: coronary heart disease as a model. Br J Gen Pract 2003;53:690-6.
148. Hutchinson A, Cooper KL, Dean JE, McIntosh A, Patterson M, Stride CB, et al. Use of a safety climate questionnaire in UK health care: factor structure, reliability and usability. Qual Saf Health Care 2006;15:347-53.
149. Hutchinson A, Coster JE, Cooper KL, McIntosh A, Walters SJ, Bath PA, et al. Assessing quality of care from hospital case notes: comparison of reliability of two methods. Qual Saf Health Care 2010;19:e2.
150. Woloshynowych M, Neale G, Vincent C. Case record review of adverse events: a new approach. Qual Saf Health Care 2003;12:411-15.
151. Hofer TP, Asch SM, Hayward RA, Rubenstein LV, Hogan MM, Adams J, et al. Profiling quality of care: is there a role for peer review? BMC Health Serv Res 2004;4:9.
152. Hulka B, Romm F, Parkerson, Jr. G, Russell I, Clapp N, Johnson F. Peer review in ambulatory care: use of explicit criteria and implicit judgements. Med Care 1979;17(Suppl.):1-73.
153. Fischoff B. Hindsight not equal to foresight: the effect of outcome knowledge on judgement under uncertainty. J Exp Psychol 1975;1:e99.
154. Ashton CM, Kuykendall DH, Johnson ML, Wray NP. An empirical assessment of the validity of explicit and implicit process-of-care criteria for quality assessment. Med Care 1999;37:798-808.
155. Rudd AG, Lowe D, Irwin P, Rutledge Z, Pearson M, Party ISW. National stroke audit: a tool for change? Qual Health Care 2001;10:141-51.
156. Hutchinson A, Coster JE, Cooper KL, McIntosh A, Walters SJ, Bath PA, et al. Comparison of case note review methods for evaluating quality and safety in health care. Health Technol Assess 2010;14(10).
157. Lilford R, Mohammed MA, Spiegelhalter D, Thomson R. Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet 2004;363:1147-54.
158. Wilson B, Thornton JG, Hewison J, Lilford RJ, Watt I, Braunholtz D, et al. The Leeds University Maternity Audit Project. Int J Qual Health Care 2002;14:175-81.
159. Neale G, Woloshynowych M, Vincent C. Exploring the causes of adverse events in NHS hospital practice. J R Soc Med 2001;94:322-30.
160. Lilford R, Edwards A, Girling A, Hofer T, Di Tanna GL, Petty J, et al. Inter-rater reliability of case-note audit: a systematic review. J Health Serv Res Policy 2007;12:173-80.
161. Ehrenberg A, Ehnfors M. The accuracy of patient records in Swedish nursing homes: congruence of record content and nurses' and patients' descriptions. Scand J Caring Sci 2001;15:303-10.
162. Zegers M, de Bruijne MC, Spreeuwenberg P, Wagner C, Groenewegen PP, van der Wal G. Quality of patient record keeping: an indicator of the quality of care? BMJ Qual Saf 2011;20:314-18.
163. Flood M, Small R. Researching labour and birth events using health information records: methodological challenges. Midwifery 2009;25:701-10.
164. Hewett DG, Watson BM, Gallois C, Ward M, Leggett BA. Intergroup communication between hospital doctors: implications for quality of patient care. Soc Sci Med 2009;69:1732-40.
165. Werner RM, Bradlow ET, Asch DA. Hospital performance measures and quality of care. LDI Issue Brief 2008;13:1-4.
166. Hansen LO, Strater A, Smith L, Lee J, Press R, Ward N, et al. Hospital discharge documentation and risk of rehospitalisation. BMJ Qual Saf 2011;20:773-8.
167. Weingart SN, Pagovich O, Sands DZ, Li JM, Aronson MD, Davis RB, et al. What can hospitalized patients tell us about adverse events? Learning from patient-reported incidents. J Gen Intern Med 2005;20:830-6.
168. Weingart SN, Price J, Duncombe D, Connor M, Sommer K, Conley KA, et al. Patientreported safety and quality of care in outpatient oncology. Jt Comm J Qual Patient Saf 2007;33:83-94.
169. Bowker G. Dismembering and remembering: classification and organizational memory. Locating design, development and use, Oksnoen Symposium, 13-18 May 1994.
170. Berg M. Practices of reading and writing: the constitutive role of the patient record in medical work. Sociol Health Illness 1996;18:499-524.
171. Fitzgerald L, Ferlie E, Wood M, Hawkins C. Interlocking interactions, the diffusion of innovations in health care. Hum Relat 2002;55:1429-49.
172. Ferlie E, Fitzgerald L, Wood M, Hawkins C. The (non) spread of innovations: the mediating role of professionals. Acad Manag J 2005;48:117-34.
173. Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, et al. Changes in safety attitude and relationship to decreased postoperative morbidity and mortality following implementation of a checklist-based surgical safety intervention. BMJ Qual Saf 2011;20:102-7.
174. Cohen J. Statistical power analysis for the behavioral sciences. 2nd edn. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.
175. Healthcare Commission. Staff survey reports. London: Healthcare Commission; 2006.
176. Boud D, Garrick J. Understanding learning at work. London: Routledge; 1999.
177. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Increasing response rates to postal questionnaires: systematic review. BMJ 2002;324:1183.
178. Catchpole K, Godden P, Giddings A, Hirst G, Dale T, Utley M, et al. Identifying and reducing errors in the operating theatre: final report. London: TSO; 2005. URL: www.haps2.bham.ac.uk/publichealth/psrp/documents/PS012_Final_Report_DeLa val.pdf
179. Statistical Toolbox: Hong Kong: Department of Obstetrics and Gynaecology, Chinese University of Hong Kong, 2010.
180. Rasbash J, Steele F, Browne W, Golstein H. A users' guide to MLwiN version 2.10. Bristol: Centre for Multilevel Modelling, University of Bristol; 2009.
181. Brown C, Hofer T, Johal A, Thomson R, Nicholl J, Franklin BD, et al. An epistemology of patient safety research: a framework for study design and interpretation. Part 3. End points and measurement. Qual Saf Health Care 2008;17:170-7.
182. College of Emergency Medicine. Clinical standards for emergency departments. London: College of Emergency Medicine; 2008.
183. Scottish Intercollegiate Guidelines Network. Hip fracture. Quick reference guide. Edinburgh: Scottish Intercollegiate Guidelines Network; 2002.
184. National Institute for Health and Clinical Excellence. Intrapartum care. Care of healthy women and their babies during childbirth. London: National Institute for Health and Clinical Excellence; 2007.
185. NHS Information Centre for Health and Social Care. Caesarean section clinical guideline. London: RCOG Press; 2004.
186. Caplan RA, Posner KL, Cheney FW. Effect of outcome on physician judgments of appropriateness of care. JAMA 1991;265:1957-60.
187. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986;1:307-10.
188. Freeth D, Ayida G, Berridge EJ, Mackintosh N, Norris B, Sadler C, et al. Multidisciplinary obstetric simulated emergency scenarios (MOSES): promoting patient safety in obstetrics with teamwork-focused interprofessional simulations. J Contin Educ Health Prof 2009;29:98-104.
189. Hospital Episode Statistics. Maternity data. London: Department of Health, 2009. URL: www.hesonline.nhs.uk/Ease/servlet/ContentServer?siteID=19378categoryiD=1 011 (accessed 23 November 2010).
190. National maternity statistics and trends. BirthChoice. URL: www.birthchoiceuk.com/ (accessed June 2011).
191. Maskell NA, Jones EL, Davies RJ, committee BMMs. Variations in experience in obtaining local ethical approval for participation in a multi-centre study. QJM 2003;96:305-7.
192. Bedward J, Davison I, Field S, Thomas H. Audit, educational development and research: what counts for ethics and research governance? Med Teach 2005;27:99-101.
193. Thompson AG, France EF. One stop or full stop? The continuing challenges for researchers despite the new streamlined NHS research governance process. BMC Health Serv Res 2010;10:124.
194. Swan J, Robertson M, Evans S. Managing clinical research in the UK. Warwick: Warwick Business School; 2009.
195. McDonach E, Barbour R, Williams B. Reflections on applying for NHS ethical approval and governance in a climate of rapid change: prioritising process over principles. Int J Soc Res Methodol 2009;12:227-41.
196. Academy of Medical Sciences. A new pathway for the regulation and governance of health research. London: Academy of Medical Sciences; 2011.
197. Goffman E. The presentation of self in everyday life. London: Penguin; 1990.
198. 198. Smart-Survey.™ URL: www.smart-survey.co.uk/ (accessed June 2011).
199. Healey AN, Undre S, Vincent CA. Developing observational measures of performance in surgical teams. Qual Saf Health Care 2004;13(Suppl. 1):i33-40.
200. Yule S, Flin R, Paterson-Brown S, Maran N, Rowley D. Development of a rating system for surgeons' non-technical skills. Med Educ 2006;40:1098-104.
201. Thompson HC, Osborne CE. Office records in the evaluation of quality of care. Med Care 1976;14:294-314.
202. Starfield B, Steinwachs D, Morris I, Bause G, Siebert S, Westin C. Concordance between medical records and observations regarding information on coordination of care. Med Care 1979;17:758-66.
203. Mays N, Pope C. Qualitative research in health care. Assessing quality in qualitative research. BMJ 2000;320:50-2.
204. NHS ICHSC. NHS hospital and community health services non-medical workforce census, England. London: NHS Information Centre for Health and Social Care; 2009.
205. Bland JM, Altman DG. Transforming data. BMJ 1996;312:770.
206. Lane D. Hyperstat online statistics textbook, 1999. URL: http://davidmlane.com/hyperstat/A14043.html (accessed June 2011).
207. British Association for A&E Medicine Clincal Effectiveness Committee. Standards for A&E departments. London: British Association for A&E Medicine; 2006.
208. Sexton J. A matter of life and death: social psychological and organizational factors related to patient outcomes in the intensive care unit. Austin, TX: University of Texas; 2002.
209. Crouch S, Robinson P, Pitts M. A comparison of general practitioner response rates to electronic and postal surveys in the setting of the National STI Prevention Program. Aust N Z J Public Health 2011;35:187-9.
210. Dixon-Woods M. What can ethnography do for quality and safety in health care? Qual Saf Health Care 2003;12:326-7.
211. Gawande A. The checklist manifesto: how to get things right. New York, NY: Metropolitan Books, 2010.
212. Bosk CL, Dixon-Woods M, Goeschel CA, Pronovost PJ. Reality check for checklists. Lancet 2009;374:444-5.
213. Brewer J, Hunter A. Foundations of multimethod research: synthesizing styles. 2nd edn. London: Sage Publications; 2005.
214. Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. Thousand Oaks, CA: Sage Publications; 2007.
215. Brannen J. Combining qualitative and quantitative approaches: an overview. In Brannen J, editor. Mixing methods: qualitative and quantitative research. Aldershot: Avebury; 1992. pp. 3-37.
216. Watts BV, Percarpio K, West P, Mills PD. Use of the Safety Attitudes Questionnaire as a measure in patient safety improvement. J Patient Saf 2010;6:206-9.
217. Sexton JB, Holzmueller CG, Pronovost PJ, Thomas EJ, McFerran S, Nunes J, et al. Variation in caregiver perceptions of teamwork climate in labor and delivery units. J Perinatol 2006;26:463-70.
218. Holden RJ, Scanlon MC, Patel NR, Kaushal R, Escoto KH, Brown RL, et al. A human factors framework and study of the effect of nursing workload on patient safety and employee quality of working life. BMJ Qual Saf 2011;20:15-24.
219. Carthy J, Clarke J. Implementing human factors in healthcare. London: Patient Safety First Campaign; 2010.
220. Gaba D, Howard S, Fish K, Smith B, Sowb Y. Simulation-based training in anesthesia crisis resource management (ACRM): a decade of experience. Simulation and Gaming 2001;32:175-93.
221. WHO (World Health Organization). Patient safety curriculum guide for medical schools. Geneva: WHO; 2009.
222. HM Treasury and Department for Business, Innovation and Skills. The plan for growth. London: HM Treasury; 2011.
223. Monahan T, Fisher JA. Benefits of 'Observer effects': lessons from the field. Qual Res 2010;10:357-76.
224. Iedema R. New approaches to researching patient safety. Soc Sci Med 2009;69:1701-4.
225. Amalberti R, Vincent C, Auroy Y, de Saint Maurice G. Violations and migrations in health care: a framework for understanding and management. Qual Saf Health Care 2006;15(Suppl. 1):i66-71.
226. Osman M. Controlling uncertainty: decision making and learning in complex worlds. Oxford: Wiley-Blackwell; 2010.
227. Sheldon H, Rasul F. Increasing response rates amongst BME and other hard to reach groups - a review of literature relevant to the national acute patients' survey. Oxford: Picker Institute; 2006.
228. Carney BT, West P, Neily J, Mills PD, Bagian JP. Differences in nurse and surgeon perceptions of teamwork: implications for use of a briefing checklist in the OR. AORN J 2010;91:722-9.
229. Singer SJ, Falwell A, Gaba DM, Baker LC. Patient safety climate in US hospitals: variation by management level. Med Care 2008;46:1149-56.
230. Parand A, Burnett S, Benn J, Pinto A, Iskander S, Vincent C. The disparity of frontline clinical staff and managers' perceptions of a quality and patient safety initiative. J Eval Clin Pract 2011;17:1184-90.
231. Donabedian A. The quality of care. How can it be assessed? JAMA 1988;260:1743-8.
232. Jha AK, Prasopa-Plaizier N, Larizgoitia I, Bates DW, Research Priority Setting Working Group of the WHO World Alliance for Patient Safety. Patient safety research: an overview of the global evidence. Qual Saf Health Care 2010;19:42-7.
233. Douglas M. Natural symbols: explorations in cosmology. London: Routledge; 1996.
234. CHI. NHS national staff survey 2003: appendix 4 - psychometric properties of scales. London, 2004: Publication by the former Commission for Health Improvement now available from the Healthcare Commission. URL: www.cqc.org.uk/publications.cfm?fde_id+2003 (accessed October 2010).
235. Carney BT, Mills PD, Bagian JP, Weeks WB. Sex differences in operating room care giver perceptions of patient safety: a pilot study from the Veterans Health Administration Medical Team Training Program. Qual Saf Health Care 2010;19:128-31.