Conducting multicenter research in healthcare simulation: Lessons learned from the INSPIRE network

Advances in Simulation

Volumn 2, Issue 1, 2017, Pages

  Cheng, Adam ^a   Kessler, David ^b   Mackinnon, Ralph ^c   Chang, Todd P ^d   Nadkarni, Vinay M ^e   Hunt, Elizabeth A ^f   Duval Arnould, Jordan ^f   Lin, Yiqun ^g   Pusic, Martin ^h   Auerbach, Marc ⁱ  

^a UNIVERSITY OF CALGARY   (Canada)

^b Columbia University Medical School ^*  (United States)

^c ROYAL MANCHESTER CHILDREN S HOSPITAL   (United Kingdom)

^d CHILDREN S HOSPITAL LOS ANGELES   (United States)

^e UNIVERSITY OF PENNSYLVANIA   (United States)

^f JOHNS HOPKINS CHILDREN S CENTER   (United States)

^g UNIVERSITY OF CALGARY   (Canada)

^h Institute for Innovation in Medical Education   (United States)

ⁱ YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Advanced Life Support; Feasibility Testing; Knowledge Translation; Primary Investigator; Site Investigator

Indexed keywords

EID: 85027459751     PISSN: None     EISSN: 20590628     Source Type: Journal    
DOI: 10.1186/s41077-017-0039-0     Document Type: Note

References (63)

1. Cheng A, Auerbach M, Hunt EA, et al. Designing and conducting simulation-based research. Pediatrics. 2014;133(6):1091–101. DOI: 10.1542/peds.2013-3267
2. Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011;306(9):978–88. DOI: 10.1001/jama.2011.1234
3. Chung KC, Song JW, Group WS. A guide to organizing a multicenter clinical trial. Plast Reconstr Surg. 2010;126(2):515–23. DOI: 10.1097/PRS.0b013e3181df64fa
4. Schwartz A, Young R, Hicks PJ, Appd LF. Medical education practice-based research networks: facilitating collaborative research. Med Teach. 2016;38(1):64–74. DOI: 10.3109/0142159X.2014.970991
5. Payne S, Seymour J, Molassiotis A, et al. Benefits and challenges of collaborative research: lessons from supportive and palliative care. BMJ Support Palliat Care. 2011;1(1):5–11. DOI: 10.1136/bmjspcare-2011-000018
6. O'Sullivan PS, Stoddard HA, Kalishman S. Collaborative research in medical education: a discussion of theory and practice. Med Educ. 2010;44(12):1175–84. DOI: 10.1111/j.1365-2923.2010.03768.x
7. Huggett KN, Gusic ME, Greenberg R, Ketterer JM. Twelve tips for conducting collaborative research in medical education. Med Teach. 2011;33(9):713–8. DOI: 10.3109/0142159X.2010.547956
8. Cheng A, Hunt EA, Donoghue A, et al. EXPRESS--Examining Pediatric Resuscitation Education Using Simulation and Scripting. The birth of an international pediatric simulation research collaborative--from concept to reality. Simul Healthc. 2011;6(1):34–41. DOI: 10.1097/SIH.0b013e3181f6a887
9. Hunt EA, Duval-Arnould J, Chime NO, et al. Building consensus for the future of paediatric simulation: a novel ‘KJ Reverse-Merlin’ methodology. BMJ Simul Technol Enhanced Learn. 2016;bmjstel-2015-000072.
10. Lattuca LR, Creamer EG. Learning as professional practice. New Dir Teach Learn. 2005;102:2–11.
11. Cheng A, Brown LL, Duff JP, et al. Improving cardiopulmonary resuscitation with a CPR feedback device and refresher simulations (CPR CARES Study): a randomized clinical trial. JAMA Pediatr. 2015;169(2):137–44. DOI: 10.1001/jamapediatrics.2014.2616
12. Cheng A, Hunt EA, Donoghue A, et al. Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial. JAMA Pediatr. 2013;167(6):528–36. DOI: 10.1001/jamapediatrics.2013.1389
13. Cheng A, Hunt EA, Grant D, et al. Variability in quality of chest compressions provided during simulated cardiac arrest across nine pediatric institutions. Resuscitation. 2015;97:13–9. DOI: 10.1016/j.resuscitation.2015.08.024
14. Cheng A, Overly F, Kessler D, et al. Perception of CPR quality: influence of CPR feedback, just-in-time CPR training and provider role. Resuscitation. 2015;87:44–50. DOI: 10.1016/j.resuscitation.2014.11.015
15. Donoghue A, Ventre K, Boulet J, et al. Design, implementation, and psychometric analysis of a scoring instrument for simulated pediatric resuscitation: a report from the EXPRESS pediatric investigators. Simul Healthc. 2011;6(2):71–7. DOI: 10.1097/SIH.0b013e31820c44da
16. Duff JP, Cheng A, Bahry LM, et al. Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation: a report from the EXPRESS pediatric research collaborative. Resuscitation. 2013;84(3):365–8. DOI: 10.1016/j.resuscitation.2012.07.018
17. Auerbach M, Fein DM, Chang TP, et al. The correlation of workplace simulation-based assessments with interns' infant lumbar puncture success: a prospective, multicenter, observational study. Simul Healthc. 2016;11(2):126–33. DOI: 10.1097/SIH.0000000000000135
18. Auerbach M, Kessler DO, Patterson M. The use of in situ simulation to detect latent safety threats in paediatrics: a cross-sectional survey. BMJ Simul Technol Enhanced Learn. 2015:bmjstel-2015-000037.
19. Chang TP, Kessler D, McAninch B, et al. Script concordance testing: assessing residents' clinical decision-making skills for infant lumbar punctures. Acad Med. 2014;89(1):128–35. DOI: 10.1097/ACM.0000000000000059
20. Kessler DO, Arteaga G, Ching K, et al. Interns' success with clinical procedures in infants after simulation training. Pediatrics. 2013;131(3):e811–20. DOI: 10.1542/peds.2012-0607
21. Kessler DO, Auerbach M, Pusic M, Tunik MG, Foltin JC. A randomized trial of simulation-based deliberate practice for infant lumbar puncture skills. Simul Healthc. 2011;6(4):197–203. DOI: 10.1097/SIH.0b013e318216bfc1
22. Kessler DO, Walsh B, Whitfill T, et al. Disparities in adherence to pediatric sepsis guidelines across a spectrum of emergency departments: a multicenter, cross-sectional observational in situ simulation study. J Emerg Med. 2016;50(3):403–15. e3. DOI: 10.1016/j.jemermed.2015.08.004
23. Kamdar G, Kessler DO, Tilt L, et al. Qualitative evaluation of just-in-time simulation-based learning: the learners' perspective. Simul Healthc. 2013;8(1):43–8. DOI: 10.1097/SIH.0b013e31827861e8
24. Auerbach M, Whitfill T, Gawel M, et al. Differences in the quality of pediatric resuscitative care across a spectrum of emergency departments. JAMA Pediatr. 2016;170(10):987–94. DOI: 10.1001/jamapediatrics.2016.1550
25. Kessler D, Pusic M, Chang TP, et al. Impact of just-in-time and just-in-place simulation on intern success with infant lumbar puncture. Pediatrics. 2015;135(5):e1237–46. DOI: 10.1542/peds.2014-1911
26. Aitken LM, Pelter MM, Carlson B, et al. Effective strategies for implementing a multicenter international clinical trial. J Nurs Scholarsh. 2008;40(2):101–8. DOI: 10.1111/j.1547-5069.2008.00213.x
27. Irving SY, Curley MA. Challenges to conducting multicenter clinical research: ten points to consider. AACN Adv Crit Care. 2008;19(2):164–9.
28. Issenberg SB, Ringsted C, Ostergaard D, Dieckmann P. Setting a research agenda for simulation-based healthcare education: a synthesis of the outcome from an Utstein style meeting. Simul Healthc. 2011;6(3):155–67. DOI: 10.1097/SIH.0b013e3182207c24
29. Hulley SB, Cummings SR, Browner WS. Designing clinical research: an epidemiologic approach. 2nd ed. Philadelphia: Lippincott Williams and Wilkins; 2001.
30. McGaghie WC, Draycott TJ, Dunn WF, Lopez CM, Stefanidis D. Evaluating the impact of simulation on translational patient outcomes. Simul Healthc. 2011;6(Suppl):S42–7. DOI: 10.1097/SIH.0b013e318222fde9
31. Brydges R, Hatala R, Zendejas B, Erwin PJ, Cook DA. Linking simulation-based educational assessments and patient-related outcomes: a systematic review and meta-analysis. Acad Med. 2015;90(2):246–56. DOI: 10.1097/ACM.0000000000000549
32. Cheng A, Lang TR, Starr SR, Pusic M, Cook DA. Technology-enhanced simulation and pediatric education: a meta-analysis. Pediatrics. 2014;133(5):e1313–23. DOI: 10.1542/peds.2013-2139
33. Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119(2):166. e7-16. DOI: 10.1016/j.amjmed.2005.10.036
34. Cook DA, Hatala R. Validation of educational assessments: a primer for simulation and beyond. Advanc Simul. 2016;1:31.
35. Cook DA, Zendejas B, Hamstra SJ, Hatala R, Brydges R. What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Adv Health Sci Educ Theory Pract. 2014;19(2):233–50. DOI: 10.1007/s10459-013-9458-4
36. Lancaster GA, Dodd S, Williamson PR. Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004;10(2):307–12. DOI: 10.1111/j.2002.384.doc.x
37. Minnick A, Kleinpell RM, Micek W, Dudley D. The management of a multisite study. J Prof Nurs. 1996;12(1):7–15. DOI: 10.1016/S8755-7223(96)80069-X
38. Boulos MN, Maramba I, Wheeler S. Wikis, blogs and podcasts: a new generation of Web-based tools for virtual collaborative clinical practice and education. BMC Med Educ. 2006;6:41. DOI: 10.1186/1472-6920-6-41
39. Bowman A, Wyman JF, Peters J. The operations manual: a mechanism for improving the research process. Nurs Res. 2002;51(2):134–8. DOI: 10.1097/00006199-200203000-00011
40. Cheng A, Nadkarni V, Hunt EA, et al. A multifunctional online research portal for facilitation of simulation-based research: a report from the EXPRESS pediatric simulation research collaborative. Simul Healthc. 2011;6(4):239–43. DOI: 10.1097/SIH.0b013e31821d5331
41. Avidan A, Weissman C, Sprung CL. An internet web site as a data collection platform for multicenter research. Anesth Analg. 2005;100(2):506–11. DOI: 10.1213/01.ANE.0000142124.62227.0F
42. Schmitt CP, Burchinal M. Data management practices for collaborative research. Front Psychiatry. 2011;2:47. DOI: 10.3389/fpsyt.2011.00047
43. Adler MD, Overly FL, Nadkarni VM, et al. An approach to confederate training within the context of simulation-based research. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare. 2016;11(5):357–62.
44. Cheng A, Kessler D, Mackinnon R, et al. Reporting guidelines for health care simulation research. Clin Simul Nurs. 2016;12(8):iii–xiii. DOI: 10.1016/j.ecns.2016.04.008
45. Cheng A, Kessler D, Mackinnon R, et al. Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE statements. BMJ Simul Technol Enhanced Learn. 2016:bmjstel-2016-000124.
46. Cheng A, Kessler D, Mackinnon R, et al. Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE statements. Advanc Simul. 2016;1:25.
47. Cheng A, Kessler D, Mackinnon R, et al. Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE statements. Simul Healthc. 2016;11(4):238–48. DOI: 10.1097/SIH.0000000000000150
48. Chung KC, Shauver MJ. Fundamental principles of writing a successful grant proposal. J Hand Surg [Am]. 2008;33(4):566–72. DOI: 10.1016/j.jhsa.2007.11.028
49. Cook DA, West CP. Perspective: reconsidering the focus on "outcomes research" in medical education: a cautionary note. Acad Med. 2013;88(2):162–7. DOI: 10.1097/ACM.0b013e31827c3d78
50. Marsolo K. Approaches to facilitate institutional review board approval of multicenter research studies. Med Care. 2012;50(Suppl):S77–81. DOI: 10.1097/MLR.0b013e31825a76eb
51. Greene SM, Geiger AM. A review finds that multicenter studies face substantial challenges but strategies exist to achieve Institutional Review Board approval. J Clin Epidemiol. 2006;59(8):784–90. DOI: 10.1016/j.jclinepi.2005.11.018
52. Winkler SJ, Witte E, Bierer BE. The Harvard Catalyst Common Reciprocal IRB Reliance Agreement: an innovative approach to multisite IRB review and oversight. Clin Transl Sci. 2015;8(1):57–66. DOI: 10.1111/cts.12202
53. Cheng A, Raemer DB. Is clinical trial registration for simulation-based research necessary? Simul Healthc. 2014;9(6):350–2. DOI: 10.1097/SIH.0000000000000064
54. Greene SM, Hart G, Wagner EH. Measuring and improving performance in multicenter research consortia. J Natl Cancer Inst Monogr. 2005;35:26–32. DOI: 10.1093/jncimonographs/lgi034
55. Knatterud GL, Rockhold FW, George SL, et al. Guidelines for quality assurance in multicenter trials: a position paper. Control Clin Trials. 1998;19(5):477–93. DOI: 10.1016/S0197-2456(98)00033-6
56. Feldman M, Lazzara EH, Vanderbilt AA, DiazGranados D. Rater training to support high-stakes simulation-based assessments. J Contin Educ Health Prof. 2012;32(4):279–86. DOI: 10.1002/chp.21156
57. Eppich W, Nannicelli AP, Seivert NP, et al. A rater training protocol to assess team performance. J Contin Educ Health Prof. 2015;35(2):83–90. DOI: 10.1002/chp.21270
58. Braga MS, Tyler MD, Rhoads JM, et al. Effect of just-in-time simulation training on provider performance and patient outcomes for clinical procedures: a systematic review. BMJ Simul Technol Enhanced Learn. 2015:bmjstel-2015-000058.
59. Gerard JM, Kessler DO, Braun C, Mehta R, Scalzo AJ, Auerbach M. Validation of global rating scale and checklist instruments for the infant lumbar puncture procedure. Simul Healthc. 2013;8(3):148–54. DOI: 10.1097/SIH.0b013e3182802d34
60. Thoma B, Poitras J, Penciner R, Sherbino J, Holroyd BR, Woods RA. Administration and leadership competencies: establishment of a national consensus for emergency medicine. CJEM. 2015;17(2):107–14. DOI: 10.2310/8000.2013.131270
61. Thoma B, Sanders JL, Lin M, Paterson QS, Steeg J, Chan TM. The social media index: measuring the impact of emergency medicine and critical care websites. West J Emerg Med. 2015;16(2):242–9. DOI: 10.5811/westjem.2015.1.24860
62. Trueger NS, Thoma B, Hsu CH, Sullivan D, Peters L, Lin M. The altmetric score: a new measure for article-level dissemination and impact. Ann Emerg Med. 2015;66(5):549–53. DOI: 10.1016/j.annemergmed.2015.04.022
63. Cheng A, Rodgers DL, van der Jagt E, Eppich W, O'Donnell J. Evolution of the Pediatric Advanced Life Support course: enhanced learning with a new debriefing tool and Web-based module for Pediatric Advanced Life Support instructors. Pediatr Crit Care Med. 2012;13(5):589–95. DOI: 10.1097/PCC.0b013e3182417709