Using a computer simulation for teaching communication skills: A blinded multisite mixed methods randomized controlled trial

Patient Education and Counseling

Volumn 100, Issue 4, 2017, Pages 748-759

  Kron, Frederick W ^a   Fetters, Michael D ^a   Scerbo, Mark W ^b   White, Casey B ^c   Lypson, Monica L ^a   Padilla, Miguel A ^b   Gliva McConvey, Gayle A ^d   Belfore, Lee A ^e   West, Temple ^d   Wallace, Amelia M ^d   Guetterman, Timothy C ^a   Schleicher, Lauren S ^a   Kennedy, Rebecca A ^b   Mangrulkar, Rajesh S ^a   Cleary, James F ^f   Marsella, Stacy C ^g   Becker, Daniel M ^h  

^a UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

^b OLD DOMINION UNIVERSITY   (United States)

^c UNIVERSITY OF VIRGINIA   (United States)

^d EASTERN VIRGINIA MEDICAL SCHOOL   (United States)

^e Old Dominion University   (United States)

^f UNIVERSITY OF WISCONSIN SCHOOL OF MEDICINE AND PUBLIC HEALTH   (United States)

^g NORTHEASTERN UNIVERSITY   (United States)

^h UNIVERSITY OF VIRGINIA HEALTH SYSTEM   (United States)

Author keywords

Breaking bad news; Communication training; Computer simulation; Computer based conversational agent; Cultural competence; Doctor patient relationship; Healthcare communication; Human computer interaction; Intelligent tutoring systems; Inter professional communication; Intercultural communication; Knowledge transfer; Mindful practice; Mixed methods research; Nonverbal communication; Reflection in action; Reflection on action; Simulation; Training transfer; Virtual Human

Indexed keywords

ADULT; ARTICLE; CLINICAL EXAMINATION; COMMUNICATION SKILL; COMPUTER SIMULATION; COMPUTER SYSTEM; CONTROLLED STUDY; EMOTION; FEMALE; HUMAN; MALE; MEDICAL STUDENT; MODELING PROFESSIONALISM AND TEACHING HUMANISTIC COMMUNICATION IN VIRTUAL REALITY; NONVERBAL COMMUNICATION; OBJECTIVE STRUCTURED CLINICAL EXAMINATION; RANDOMIZED CONTROLLED TRIAL; SINGLE BLIND PROCEDURE; STUDENT ATTITUDE; CLINICAL COMPETENCE; COMPUTER INTERFACE; CURRICULUM; DOCTOR PATIENT RELATION; INTERPERSONAL COMMUNICATION; MEDICAL EDUCATION; PATIENT SIMULATION; PSYCHOLOGY;

ADULT; CLINICAL COMPETENCE; COMMUNICATION; COMPUTER SIMULATION; CURRICULUM; EDUCATION, MEDICAL; FEMALE; HUMANS; MALE; PATIENT SIMULATION; PHYSICIAN-PATIENT RELATIONS; SINGLE-BLIND METHOD; STUDENTS, MEDICAL; USER-COMPUTER INTERFACE;

EID: 85008205645     PISSN: 07383991     EISSN: 18735134     Source Type: Journal    
DOI: 10.1016/j.pec.2016.10.024     Document Type: Article

References (150)

1. [1] Ong, L.M., De Haes, J.C., Hoos, A.M., Lammes, F.B., Doctor-patient communication: a review of the literature. Soc. Sci. Med. 40:7 (1995), 903–918.
2. [2] Hampton, J., Harrison, M., Mitchell, J., Prichard, J., Seymour, C., Relative contributions of history-taking, physical examination, and laboratory investigation to diagnosis and management of medical outpatients. BMJ 2:5969 (1975), 486–489.
3. [3] Hickson, G.B., Clayton, E.W., Githens, P.B., Sloan, F.A., Factors that prompted families to file medical malpractice claims following perinatal injuries. J. Am. Med. Assoc. 267:10 (1992), 1359–1363.
4. [4] Hickson, G.B., Clayton, E.W., Entman, S.S., Miller, C.S., Githens, P.B., Whetten-Goldstein, K., Sloan, F.A., Obstetricians’ prior malpractice experience and patients’ satisfaction with care. J. Am. Med. Assoc. 272:20 (1994), 1583–1587.
5. [5] Levinson, W., Roter, D.L., Mullooly, J.P., Dull, V.T., Frankel, R.M., Physician-patient communication. The relationship with malpractice claims among primary care physicians and surgeons. JAMA 277:7 (1997), 553–559.
6. [6] Hickson, G.B., Pichert, J.W., Federspiel, C.F., Clayton, E.W., Medical malpractice: external influences and controls, Part 1: development of an early identification and response model of malpractice prevention. Law Contemp. Probl. 60:1 (1997), 7–29.
7. [7] Peterson, M.C., Holbrook, J.H., Von Hales, D., Smith, N.L., Staker, L.V., Contributions of the history, physical examination, and laboratory investigation in making medical diagnoses. West. J. Med. 156:2 (1992), 163–165.
8. [8] Tamblyn, R., Abrahamowicz, M., Dauphinee, D., Wenghofer, E., Jacques, A., Klass, D., Smee, S., Blackmore, D., Winslade, N., Girard, N., Du Berger, R., Bartman, I., Buckeridge, D.L., Hanley, J.A., Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities. JAMA 298:9 (2007), 993–1001.
9. [9] Stelfox, H.T., Gandhi, T.K., Orav, E.J., Gustafson, M.L., The relation of patient satisfaction with complaints against physicians and malpractice lawsuits. Am. J. Med. 118:10 (2005), 1126–1133.
10. [10] Sloan, F.A., Mergenhagen, P.M., Burfield, W.B., Bovbjerg, R.R., Hassan, M., Medical malpractice experience of physicians. Predictable or haphazard?. JAMA 262:23 (1989), 3291–3297.
11. [11] Papadakis, M.A., Teherani, A., Banach, M.A., Knettler, T.R., Rattner, S.L., Stern, D.T., Veloski, J.J., Hodgson, C.S., Disciplinary action by medical boards and prior behavior in medical school. N. Engl. J. Med. 353:25 (2005), 2673–2682.
12. [12] Moore, P.J., Adler, N.E., Robertson, P.A., Medical malpractice: the effect of doctor-patient relations on medical patient perceptions and malpractice intentions. West. J. Med. 173:4 (2000), 244–250.
13. [13] Kohatsu, N.D., Gould, D., Ross, L.K., Fox, P.J., Characteristics associated with physician discipline: a case-control study. Arch. Intern. Med. 164:6 (2004), 653–658.
14. [14] Hickson, G.B., Federspiel, C.F., Pichert, J.W., Miller, C.S., Gauld-Jaeger, J., Bost, P., Patient complaints and malpractice risk. JAMA 287:22 (2002), 2951–2957.
15. [15] Franks, P., Fiscella, K., Shields, C.G., Meldrum, S.C., Duberstein, P., Jerant, A.F., Tancredi, D.J., Epstein, R.M., Are patients’ ratings of their physicians related to health outcomes?. Ann. Fam. Med. 3:3 (2005), 229–234.
16. [16] Fiscella, K., Meldrum, S., Franks, P., Shields, C.G., Duberstein, P., McDaniel, S.H., Epstein, R.M., Patient trust: is it related to patient-centered behavior of primary care physicians?. Med. Care 42:11 (2004), 1049–1055.
17. [17] Bovbjerg, R.R., Petronis, K.R., The relationship between physicians’ malpractice claims history and later claims. Does the past predict the future?. JAMA 272:18 (1994), 1421–1426.
18. [18] Beckman, H.B., Markakis, K.M., Suchman, A.L., Frankel, R.M., The doctor-patient relationship and malpractice. Lessons from plaintiff depositions. Arch. Intern. Med. 154:12 (1994), 1365–1370.
19. [19] Baldwin, L.M., Larson, E.H., Hart, L.G., Greer, T., Lloyd, M., Rosenblatt, R.A., Characteristics of physicians with obstetric malpractice claims experience. Obstet. Gynecol. 78:6 (1991), 1050–1054.
20. [20] Heszen-Klemens, I., Lapińska, E., Doctor-patient interaction, patients' health behavior and effects of treatment. Soc. Sci. Med. 19:1 (1984), 9–18.
21. [21] Epstein, R.M., Hadee, T., Carroll, J., Meldrum, S.C., Lardner, J., Shields, C.G., Could this be something serious?. J. Gen. Intern. Med. 22:12 (2007), 1731–1739.
22. [22] The Joint Commission, Sentinel Event Root Cause and Trend Data, Improving America's Hospitals: The Joint Commission's Annual Report on Quality and Safety 2007, 2008, pp. 45–46.
23. [23] Woods, D.M., Holl, J.L., Angst, D., Echiverri, S.C., Johnson, D., Soglin, D.F., Srinivasan, G., Barnathan, J., Amsden, L., Lamkin, L., Weiss, K.B., Improving clinical communication and patient safety: clinician-recommended solutions. Henriksen, K., Battles, J.B., Keyes, M.A., (eds.) Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 3: Performance and Tools), Institute for Healthcare Studies, Feinberg School of Medicine, 2008, Northwestern University, Rockville, MD.
24. [24] Leape, L.L., Patient safety in the era of healthcare reform. Clin. Orthop. 473:5 (2015), 1568–1573.
25. [25] Leape, L.L., The checklist conundrum. New Engl. J. Med. 370:11 (2014), 1063–1064.
26. [26] Lucian Leape Institute Roundtable on Reforming Medical Education, Unmet Needs: Teaching Physicians to Provide Safe Patient Care, National Patient Safety Foundation Boston 2010.
27. [27] Epstein, R.M., Fiscella, K., Lesser, C.S., Stange, K.C., Why the nation needs a policy push on patient-centered health care. Health Aff. (Millwood) 29:8 (2010), 1489–1495.
28. [28] Hawken, S., Good communication skills: benefits for doctors and patients. N. Z. Fam. Phys. 32:3 (2005), 185–189.
29. [29] Levinson, W., Lesser, C.S., Epstein, R.M., Developing physician communication skills for patient-centered care. Health Aff. (Millwood) 29:7 (2010), 1310–1318.
30. [30] Levinson, W., Pizzo, P.A., Patient-physician communication: it's about time. JAMA 05:17 (2011), 1802–1803.
31. [31] Kohn, L.T., Corrigan, J.M., Donaldson, M.S., To Err Is Human: Building a Safer Health System. 2000, National Academies Press, Washington, DC.
32. [32] van Dalen, J., Communication skills in context: trends and perspectives. Patient Educ. Couns. 92:3 (2013), 292–295.
33. [33] Smedley, B.D., Smith, A.Y., Nelson, A.R., Unequal Treatment: Confronting Racial and Ethnic Disparities in Healthcare. 2003, National Academies Press, Washington, DC.
34. [34] Liaison Committee on Medical Education (LCME), Functions and Structure of a Medical School, 2013.
35. [35] Nasca, T.J., Philibert, I., Brigham, T., Flynn, T.C., The next GME accreditation system–rationale and benefits. N. Engl. J. Med. 366:11 (2012), 1051–1056.
36. [36] Del Piccolo, L., Mazzi, M.A., Dunn, G., Sandri, M., Zimmermann, C., Sequence analysis in multilevel models. A study on different sources of patient cues in medical consultations. Soc. Sci. Med. 65:11 (2007), 2357–2370.
37. [37] Henry, S.G., Fetters, M.D., Video elicitation interviews: a qualitative research method for investigating physician-patient interactions. Ann. Fam. Med. 10:2 (2012), 118–125.
38. [38] Brugel, S., Postma-Nilsenova, M., Tates, K., The link between perception of clinical empathy and nonverbal behavior: the effect of a doctor's gaze and body orientation. Patient Educ. Couns. 98:10 (2015), 1260–1265.
39. [39] Sandvik, M., Eide, H., Lind, M., Graugaard, P.K., Torper, J., Finset, A., Analyzing medical dialogues: strength and weakness of Roter's interaction analysis system (RIAS). Patient Educ. Couns. 46:4 (2002), 235–241.
40. [40] Beach, W.A., Conversation analysis. Thompson, T.L., (eds.) Encyclopedia of Health Communication, 2014, Sage, Los Angeles, 263–264.
41. [41] Roter, D., Larson, S., The Roter interaction analysis system (RIAS): utility and flexibility for analysis of medical interactions. Patient Educ. Couns. 46:4 (2002), 243–251.
42. [42] Meredith, L., Stewart, M., Brown, J.B., Patient-centered communication scoring method report on nine coded interviews. Health Commun. 13:1 (2001), 19–31.
43. [43] Shaikh, A., Knobloch, L.M., Stiles, W.B., The use of a verbal response mode coding system in determining patient and physician roles in medical interviews. Health Commun. 13:1 (2001), 49–60.
44. [44] Street, R.L. Jr., Millay, B., Analyzing patient participation in medical encounters. Health Commun. 13:1 (2001), 61–73.
45. [45] Ekman, P., Rosenberg, E.L., What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). 1997, Oxford University Press, USA, New York.
46. [46] Brown, J., Stewart, M., Tessier, S., Assessing Communication Between Patients and Doctors: a Manual for Scoring Patient-centred Communication #95-2. 1995, Western University, Ontario.
47. [47] Stiles, W.B., Describing Talk: A Taxonomy of Verbal Response Modes. 1992, Sage Publications, Newbury Park.
48. [48] Roter, D.L., Hall, J.A., Studies of doctor-patient interaction. Annu. Rev. Public Health 10 (1989), 163–180.
49. [49] Ekman, P., Friesen, W., Facial Action Coding System: a Technique for the Measurement of Facial Movement. 1978, Consulting Psychologists, San Francisco.
50. [50] Fremon, B., Negrete, V.F., Davis, M., Korsch, B.M., Gaps in doctor-patient communication: doctor-patient interaction analysis. Pediatr. Res. 5:7 (1971), 298–311.
51. [51] Bales, R.F., Interaction Process Analysis; a Method for the Study of Small Groups. 1951, Addison-Wesley Press, Los Angeles.
52. [52] Deveugele, M., Derese, A., De Maesschalck, S., Willems, S., Van Driel, M., De Maeseneer, J., Teaching communication skills to medical students, a challenge in the curriculum?. Patient Educ. Couns. 58:3 (2005), 265–270.
53. [53] Gysels, M., Richardson, A., Higginson, I.J., Communication training for health professionals who care for patients with cancer: a systematic review of effectiveness. Support. Care Cancer 12:10 (2004), 692–700.
54. [54] Satterfield, J.M., Hughes, E., Emotion skills training for medical students: a systematic review. Med. Educ. 41:10 (2007), 935–941.
55. [55] Whitehead, C.R., Kuper, A., Hodges, B., Ellaway, R., Conceptual and practical challenges in the assessment of physician competencies. Med. Teach. 37:3 (2015), 245–251.
56. [56] Bickmore, T., Marsella, S., Sidner, C., Intelligent Virtual Agents: 14th International Conference, IVA 2014, Boston, MA, USA, August 27–29, 2014, Proceedings, Springer New York, 2014.
57. [57] Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R.J., Morency, L.P., Virtual rapport. Intelligent Virtual Agents, 2006, Springer Publishing Company, Berlin; Heidelberg, 14–27.
58. [58] Hoque, M.E., Courgeon, M., Martin, J.C., Mutlu, B., Picard, R.W., Mach: my automated conversation coach. The 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing ACM, Zurich, Switzerland, 2013, 697–706.
59. [59] Pelachaud, C., Multimodal expressive embodied conversational agents. Thirteenth ACM International Conference on Multimedia ACM, Singapore, 2005.
60. [60] Swartout, W.R., Gratch, J., Hill, R.W. Jr, Hovy, E., Marsella, S., Rickel, J., Traum, D., Toward virtual humans. AI Mag., 27(2), 2006, 96.
61. [61] Deveugele, M., Communication training: skills and beyond. Patient Educ. Couns. 98:10 (2015), 1287–1291.
62. [62] Tickle-Degnen, L., Rosenthal, R., The nature of rapport and its nonverbal correlates. Psychol. Inq. 1:4 (1990), 285–293.
63. [63] Baile, W.F., Buckman, R., Lenzi, R., Glober, G., Beale, E.A., Kudelka, A.P., SPIKES-A six-step protocol for delivering bad news: application to the patient with cancer. Oncologist 5:4 (2000), 302–311.
64. [64] Rust, G., Kondwani, K., Martinez, R., Dansie, R., Wong, W., Fry-Johnson, Y., Woody Rdel, M., Daniels, E.J., Herbert-Carter, J., Aponte, L., Strothers, H., A crash-course in cultural competence. Ethn. Dis., 2(Suppl 3), 2006 (S3-29-36).
65. [65] Agency for Healthcare Research and Quality, TeamSTEPPS: Strategies and Tools to Enhance Performance and Patient Safety. 2015, Agency for Healthcare Research and Quality http://www.ahrq.gov/professionals/education/curriculum-tools/teamstepps/index.html (Accessed 12 January 2015).
66. [66] Agency for Healthcare Research, Quality, TeamSTEPPS: Tips and Tools for Connecting: PEARLA. 2010, Agency for Healthcare Research and Quality https://www.med.unc.edu/ihqi/files/teamstepps/coaching/Professional%20Conduct (Accessed 30 June 2016).
67. [67] Kurtz, S.M., Silverman, J.D., The Calgary—Cambridge Referenced Observation Guides: an aid to defining the curriculum and organizing the teaching in communication training programmes. Med. Educ. 30:2 (1996), 83–89.
68. [68] Silverman, J., Kurtz, S., Draper, J., Skills for Communicating with Patients. 2016, CRC Press.
69. [69] Salmon, P., Young, B., Creativity in clinical communication: from communication skills to skilled communication. Med. Educ. 45:3 (2011), 217–226.
70. [70] Dewey, J., How We Think. Buffalo. 1933, PrometheusBooks, New York.
71. [71] Schön, D.A., Knowing-in-action: the new scholarship requires a new epistemology. Change: Mag. Higher Learn. 27:6 (1995), 27–34.
72. [72] Schön, D.A., The theory of inquiry: dewey's legacy to education. Curriculum Inq. 22:2 (1992), 119–139.
73. [73] Schön, D.A., The Reflective Practitioner: How Professionals Think in Action. 1983, Basic Books, New York.
74. [74] Argyris, C., Double-loop learning, teaching, and research. Acad. Manage. Learn. Educ. 1:2 (2002), 206–218.
75. [75] Söderström, T., Häll, L., Nilsson, T., Ahlqvist, J., Computer simulation training in health care education fuelling reflection-in-action?. Simul. Gaming 45:6 (2014), 805–828.
76. [76] Arendt, H., Thinking, Vol. 1 of the Life of the Mind. 1971, Harcourt Brace, Jaovanovich, New York.
77. [77] Greenwood, J., The role of reflection in single and double loop learning. J. Adv. Nurs. 27:5 (1998), 1048–1053.
78. [78] Epstein, R.M., Realizing Engel's biopsychosocial vision: resilience, compassion, and quality of care. Int. J. Psychiatry Med. 47:4 (2014), 275–287.
79. [79] Lin, X., Schwartz, D.L., Hatano, G., Toward teachers’ adaptive metacognition. Educ. Psychol. 40:4 (2005), 245–255.
80. [80] Emily Hayden, H., Moore-Russo, D., Marino, M.R., One teacher's reflective journey and the evolution of a lesson: systematic reflection as a catalyst for adaptive expertise. Reflect. Pract. 14:1 (2013), 144–156.
81. [81] McGaghie, W.C., Issenberg, S.B., Petrusa, E.R., Scalese, R.J., A critical review of simulation-based medical education research: 2003–2009. Med. Educ. 44:1 (2010), 50–63.
82. [82] Fanning, R.M., Gaba, D.M., The role of debriefing in simulation-based learning. Simul. Healthc. 2:2 (2007), 115–125.
83. [83] Issenberg, S.B., McGaghie, W.C., Petrusa, E.R., Lee Gordon, D., Scalese, R.J., Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med. Teach. 27:1 (2005), 10–28.
84. [84] McGaghie, W.C., Issenberg, S.B., Cohen, E.R., Barsuk, J.H., Wayne, D.B., Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad. Med. 86:6 (2011), 706–711.
85. [85] Sorden, S.D., The cognitive theory of multimedia learning. Irby, B.J., Lara-Alecio, R., (eds.) Handbook of Educational Theories, 2012, Information Age Publishing, Charlotte, 1–31.
86. [86] Sessoms, D., Interactive instruction: creating interactive learning environments through tomorrow's teachers. Int. J. Technol. Teach. Learn. 4:2 (2008), 86–96.
87. [87] Domagk, S., Schwartz, R.N., Plass, J.L., Interactivity in multimedia learning: an integrated model. Comput. Human Behav. 26:5 (2010), 1024–1033.
88. [88] Miller, W.R., Rollnick, S., Motivational Interviewing: Preparing People to Change Addictive Behavior. 1991, Guilford Press, New York.
89. [89] Back, A.L., Arnold, R.M., Baile, W.F., Tulsky, J.A., Fryer-Edwards, K., Approaching difficult communication tasks in oncology. CA: Cancer J. Clin. 55:3 (2005), 164–177.
90. [90] Pollak, K.I., Childers, J.W., Arnold, R.M., Applying motivational interviewing techniques to palliative care communication. J. Palliat. Med. 14:5 (2011), 587–592.
91. [91] Rogers, C.R., A theory of therapy, personality, and interpersonal relationships: as developed in the client-centered framework. Koch, S., (eds.) Psychology: The Study of a Science. Vol 3. Formations of the Person and the Social Context, 1959, McGraw-Hill, New York, 184–256.
92. [92] Quill, T.E., Arnold, R.M., Platt, F., I wish things were different: expressing wishes in response to loss, futility, and unrealistic hopes. Ann. Intern. Med. 135:7 (2001), 551–555.
93. [93] Argyle, M., Lefebvre, L., Cook, M., The meaning of five patterns of gaze. Eur. J. Soc. Psychol. 4 (1974), 125–136.
94. [94] Ekman, P., Emotion in the Human Face: Guidelines for Research and an Integration of Findings. 2nd ed., 1982, Cambridge University Press, Editions de la Maison des Sciences de l'Homme, Cambridge, Cambridgeshire.
95. [95] Ekman, P., Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life. 2nd ed., 2007, Henry Holt and Company, LLC, New York.
96. [96] Argyle, M., Cook, M., Gaze and Mutual Gaze. 1976, Cambridge University Press, Cambridge, England.
97. [97] Warner, R., Coordinated cycles in behavior and physiology during face-to-face social interactions. Watt, J.H., VanLear, C.A., (eds.) Dynamic Patterns in Communication Processes, 1996, SAGE Publications, Thousand Oaks.
98. [98] Kendon, A., Cook, M., Consistency of gaze patterns in social interaction. Br. J. Psychol. 60 (1969), 481–494.
99. [99] Maslow, C., Yoselson, K., London, H., Persuasiveness of confidence expressed via language and body language. Br. J. Soc. Clin. Psychol. 10:Sep (1971), 234–240.
100. [100] Yngve, V.H., On getting a word in edgewise. Sixth Regional Meeting of the Chicago Linquistic Society, 1970, 567–578.
101. [101] Burgoon, J.K., Birk, T., Pfau, M., Nonverbal behaviors, persuasion, and credibility. Hum. Commun. Res. 17:1 (1990), 140–169.
102. [102] Mehrabian, A., Williams, M., Nonverval concomitants of perceived and intended persuasiveness. J. Pers. Soc. Psychol. 13:1 (1969), 37–58.
103. [103] Grahe, J.E., Bernieri, F.J., The importance of nonverbal cues in judging rapport. J. Nonverbal Behav. 23:4 (1999), 253–269.
104. [104] Lakin, J.L., Jefferis, V.E., Cheng, C.M., Chartrand, T.L., The chameleon effect as social glue: evidence for the evolutionary significance of nonconscious mimicry. J. Nonverbal Behav. 27:3 (2003), 145–162.
105. [105] Sonnby-Borgstrom, M., Jonsson, P., Svensson, O., Emotional empathy as related to mimicry reactions at different levels of information processing. J. Nonverbal Behav. 27:1 (2003), 3–23.
106. [106] McFarland, D.H., Respiratory markers of conversational interaction. J. Speech Lang. Hear. Res. 44:1 (2001), 128–143.
107. [107] van Baaren, R.B., Holland, R.W., Kawakami, K., A. van Knippenberg, Mimicry and prosocial behavior. Psychol. Sci. 15:1 (2004), 71–74.
108. [108] Ohtaki, S., Ohtaki, T., Fetters, M.D., Doctor–patient communication: a comparison of the USA and Japan. Fam. Pract. 20:3 (2003), 276–282.
109. [109] Masuda, Y., Fetters, M.D., Hattori, A., Mogi, N., Naito, M., Iguchi, A., Uemura, K., Physicians's reports on the impact of living wills at the end of life in Japan. J. Med. Ethics 29:4 (2003), 248–252.
110. [110] Hammoud, M.M., White, C.B., Fetters, M.D., Opening cultural doors: providing culturally sensitive healthcare to Arab American and American Muslim patients. Am. J. Obstet. Gynecol. 193:4 (2005), 1307–1311.
111. [111] Wooldridge, A.N., Arató, N., Sen, A., Amenomori, M., Fetters, M.D., Truth or fallacy? Three hour wait for three minutes with the doctor: findings from a private clinic in rural Japan. Asia Pacific Fam. Med., 9(1), 2010, 1.
112. [112] Little, S.H., Motohara, S., Miyazaki, K., Arato, N., Fetters, M.D., Prenatal group visit program for a population with limited English proficiency. J. Am. Board Fam. Med. 26:6 (2013), 728–737.
113. [113] Killawi, A., Khidir, A., Elnashar, M., Abdelrahim, H., Hammoud, M., Elliott, H., Thurston, M., Asad, H., Al-Khal, A.L., Fetters, M.D., Procedures of recruiting, obtaining informed consent, and compensating research participants in Qatar: findings from a qualitative investigation. BMC Med. Ethics, 15(1), 2014, 1.
114. [114] Teo, A.R., Fetters, M.D., Stufflebam, K., Tateno, M., Balhara, Y., Choi, T.Y., Kanba, S., Mathews, C.A., Kato, T.A., Identification of the hikikomori syndrome of social withdrawal: psychosocial features and treatment preferences in four countries. Int. J. Soc. Psychiatry 1:1 (2015), 64–72.
115. [115] Kim, J.M., Hill, R.W. Jr., Durlach, P.J., Lane, H.C., Forbell, E., Core, M., Marsella, S., Pynadath, D., Hart, J., BiLAT. Agame-based environment for practicing negotiation in a cultural context. Int. J. Artif. Intell. Educ. 19:3 (2009), 289–308.
116. [116] Johnson, W.L., Marsella, S., Mote, N., Viljhálmsson, H., Narayanan, S., Choi, S., Tactical language training system: Supporting the rapid acquisition of foreign language and cultural skills. InSTIL/ICALL Symposium 2004, 2004.
117. [117] Turner, T.R., Scerbo, M.W., Gliva-McConvey, G.A., Wallace, A.M., Standardized patient encounters: periodic versus postencounter evaluation of nontechnical clinical performance. Simul. Healthc. 11:3 (2016), 164–172.
118. [118] Scerbo, M.W., Turner, R., Padilla, M., Gliva-McConvey, G., Walker, P., Teaching communication skills using standardized patients in a team scenario: a G theory analysis. Simul. Healthc., 6(6), 2011, 482.
119. [119] Schmidt, R.A., Bjork, R.A., New conceptualizations of practice: common principles in three paradigms suggest new concepts for training. Psychol. Sci. 3 (1992), 207–217.
120. [120] Eiriksdottir, E., Catrambone, R., Procedural instructions, principles, and examples: how to structure instructions for procedural tasks to enhance performance, learning, and transfer. Hum. Factors 53:6 (2011), 749–770.
121. [121] Boyd, A.D., Hosnerc, C., Hunscherc, D.A., Atheya, B.D., Daniel, D.J., Clauwc, J., Green, L.A., An ‘Honest Broker’ mechanism to maintain privacy for patient care and academic medical research. Int. J. Med. Inf. 76:5–6 (2007), 407–411.
122. [122] Ross, P.T., Lypson, M.L., Using artistic-narrative to stimulate reflection on physician bias. Teach. Learn. Med. 26:4 (2014), 344–349.
123. [123] SAS release 9.3 [statistical software], SAS, Institute, Inc., Cary, NC, 2014.
124. [124] VERBI GmbH, MAXQDA release 11.0.11 [qualitative data analysis software] VERBI GmbH, Berlin, Germany, 2014.
125. [125] Kuckartz, U., Qualitative Text Analysis: A Guide to Methods, Practice and Using Software. 2014, SAGE Publications Ltd., London.
126. [126] Creswell, J.W., 30 Essential Skills for the Qualitative Researcher. 2015, Sage Thousand, Oaks.
127. [127] Creswell, J.W., Qualitative Inquiry and Research Design: Choosing Among Five Approaches. 3rd ed., 2013, Sage Publications, Los Angeles.
128. [128] Fetters, M.D., Curry, L.A., Creswell, J.W., Achieving integration in mixed methods designs-principles and practices. Health Serv. Res. 48:6 Pt. 2 (2013), 2134–2156.
129. [129] Guetterman, T.C., Fetters, M.D., Creswell, J.W., Integrating quantitative and qualitative results in health science mixed methods research through joint displays. Ann. Fam. Med. 13:6 (2015), 554–561.
130. [130] Crocker, L., Algina, J., Introduction to Classical and Modern Test Theory. 1986, Harcourt Brace, Orlando.
131. [131] Alt, D., Assessing the contribution of a constructivist learning environment to academic self-efficacy in higher education. Learn. Environ. 18:1 (2015), 47–67.
132. [132] Chau, M., Wong, A., Wang, M., Lai, S., Chan, K.W., Li, T.M., Sung, W.K., Using 3D virtual environments to facilitate students in constructivist learning. Decis. Supp. Syst. 56 (2013), 115–121.
133. [133] Dewey, J., Education and Experience. 1938, Simon and Schuster, New York.
134. [134] Kolb, D.A., Experiential Learning: Experience as the Source of Learning and Development. 1984, Prentice Hall Englewood Cliffs.
135. [135] Pluye, P., Hong, Q.N., Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu. Rev. Public Health 35:1 (2014), 29–45.
136. [136] Gick, M.L., Holyoak, K.J., Analogical problem solving. Cognit. Psychol. 12 (1980), 306–355.
137. [137] Kotovsky, K., Hayes, J.R., Simon, H., Why are some problems hard? Evidence from the Tower of Hanoi. Cognit. Psychol. 17 (1985), 248–294.
138. [138] Greeno, J.G., Middle School Mathematics Through Applications Project Group, The situativity of knowing, learning, and research. Am. Psychol. 53:1 (1998), 5–26.
139. [139] Cook, D.A., Hatala, R., Brydges, R., Zendejas, B., Szostek, J.H., Wang, A.T., Erwin, P.J., Hamstra, S.J., Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 306:9 (2011), 978–988.
140. [140] McGaghie, W.C., Issenberg, S.B., Petrusa, E.R., Scalese, R.J., Effect of practice on standardised learning outcomes in simulation-based medical education. Med. Educ. 40:8 (2006), 792–797.
141. [141] Sutherland, L.M., Middleton, P.F., Anthony, A., Hamdorf, J., Cregan, P., Scott, D., Maddern, G.J., Surgical simulation: a systematic review. Ann. Surg. 243:3 (2006), 291–300.
142. [142] Sturm, L.P., Windsor, J.A., Cosman, P.H., Cregan, P., Hewett, P.J., Maddern, G.J., A systematic review of skills transfer after surgical simulation training. Ann. Surg. 248:2 (2008), 166–179.
143. [143] Gurusamy, K., Aggarwal, R., Palanivelu, L., Davidson, B.R., Systematic review of randomized controlled trials on the effectiveness of virtual reality training for laparoscopic surgery. Br. J. Surg. 95:9 (2008), 1088–1097.
144. [144] Kramer, N.C., Bente, G., Piesk, J., The Ghost in the Machine: The Influence of Embodied Conversational Agents on User Expectations and User Behaviour in a Tv/vcr Application, IMC Workshop 2003. 2003, Assistance, Mobility, Applications Rostock, 121–128.
145. [145] Maatman, M., Gratch, J., Natural behavior of a listening agent. The 5th International Working Conference on Intelligent Virtual Agents, Kos Greece, 2005.
146. [146] Sproul, L., Subramani, M., Kiesler, S., Walker, J., Waters, K., When the interface is a face. Hum.-Comp. Interact., 11(2), 1996, 27.
147. [147] The effects of animated characters on anxiety, task performance, and evaluations of user interfaces. Rickenberg, R., Reeves, B., (eds.) The SIGCHI Conference on Human Factors in Computing Systems The Hague, The Netherlands, 2000.
148. [148] de Melo, C., Carnevale, P., Gratch, J., et al. The influence of emotions in embodied agents on human decision-making. Allbeck, J., (eds.) Intelligent Virtual Agents, 2010, Springer-Verlag GmbH, Berlin, Heidelberg, 357–370.
149. [149] Lucas, G.M., Gratch, J., King, A., Morency, L.P., It's only a computer: virtual humans increase willingness to disclose. Comp. Hum. Behav. 37 (2014), 94–100.
150. [150] Zhou, F., Torre, F.D.I., Cohn, J.F., Unsupervised discovery of facial events. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE San Francisco, 2010, 13–18.