Analysis of threats to research validity introduced by audio recording clinic visits: Selection bias, Hawthorne effect, both, or neither?

Patient Education and Counseling

Volumn 98, Issue 7, 2015, Pages 849-856

  Henry, Stephen G ^a,b   Jerant, Anthony ^b   Iosif, Ana Maria ^a   Feldman, Mitchell D ^c   Cipri, Camille ^b   Kravitz, Richard L ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Audio recording; Consent; Depression; Hawthorne effect; Primary care; Selection bias

Indexed keywords

ADULT; AMBULATORY CARE; ARTICLE; AUDIO RECORDING; CAUCASIAN; CONTROLLED STUDY; DEPRESSION; DIABETES MELLITUS; FEMALE; HAWTHORNE EFFECT; HEALTH SERVICE; HUMAN; INFORMED CONSENT; MALE; PATIENT; PREVENTIVE MEDICINE; PRIORITY JOURNAL; SELECTION BIAS; CALIFORNIA; CLINICAL COMPETENCE; DOCTOR PATIENT RELATION; EPIDEMIOLOGY; INTERPERSONAL COMMUNICATION; METHODOLOGY; PRIMARY HEALTH CARE; PROCEDURES; RANDOMIZED CONTROLLED TRIAL (TOPIC); RECORDING; REGRESSION ANALYSIS; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STANDARDS; STATISTICS AND NUMERICAL DATA;

ADULT; CALIFORNIA; CLINICAL COMPETENCE; COMMUNICATION; DEPRESSION; FEMALE; HUMANS; MALE; OFFICE VISITS; PHYSICIAN-PATIENT RELATIONS; PRIMARY HEALTH CARE; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; SELECTION BIAS; SENSITIVITY AND SPECIFICITY; TAPE RECORDING;

EID: 84929044114     PISSN: 07383991     EISSN: 18735134     Source Type: Journal    
DOI: 10.1016/j.pec.2015.03.006     Document Type: Article

References (51)

1. Noordman J., van der Weijden T., van Dulmen S. Communication-related behavior change techniques used in face-to-face lifestyle interventions in primary care: a systematic review of the literature. Patient Educ Couns 2012, 89:227-244.
2. Haskard-Zolnierek K., DiMatteo M.R. Physician communication and patient adherence to treatment: a meta-analysis. Med Care 2009, 47:826-834.
3. Trangle M., Dieperink B., Gabert T., Haight B., Lindvall B., Mitchell J., et al. Major depression in adults in primary care 2012, Institute for Clinical Systems Improvement, Bloomington, MN.
4. Donabedian A. The quality of care: how can it be assessed. J Am Med Assoc 1988, 260:1743-1748.
5. Hrisos S., Eccles M.P., Francis J.J., Dickinson H.O., Kaner E.F.S., Beyer F., et al. Are there valid proxy measures of clinical behaviour? a systematic review. Implement Sci 2009, 4:37.
6. Bradshaw D., Cohen C.E., Day S., Mandalia S., Theobald N. Acceptability of video recordings of consultations in HIV and genitourinary medicine (GUM). Patient Educ Couns 2013, 92:279-280.
7. Rushmer R., Themessel-Huber M., Coyle J., Humphris G., Dowell J., Williams B. Is the routine recording of primary care consultations possible and desirable? Lessons for researchers from a consultation with multiple stakeholders. Patient Educ Couns 2011, 82:247-253.
8. Grimes D.A., Schulz K.F. Bias and causal associations in observational research. Lancet 2002, 359:248-252.
9. Themessl-Huber M., Humphris G., Dowell J., Macgillivray S., Rushmer R., Williams B. Audio-visual recording of patient-GP consultations for research purposes: a literature review on recruiting rates and strategies. Patient Educ Couns 2008, 71:157-168.
10. Coleman T. Sampling for qualitative research using quantitative methods. 2. Characteristics of GPs who agree to video-taping of consultations. Fam Pract 1996, 13:531-535.
11. Howe A. Refusal of videorecording: what factors may influence patient consent. Fam Pract 1997, 14:233-237.
12. Martin E., Martin P.M. The reactions of patients to a video camera in the consulting room. J R Coll Gen Pract 1984, 34:607-610.
13. Neal R.D., Ali N., Allgar V., Coleman T. Consent rates for video-recording general practice consultations: effect of ethnicity and other factors. Fam Pract 2004, 21:219-220.
14. van den Brink-Muinen A., Verhaak P.F.M., Bensing J., Bahrs O., Deveugele M., Gask L., et al. The Eurocommunication study. An international comparitive study in six European countries on doctor-patient communication 1999, NIVEL, Utrecht, Netherlands.
15. Coleman T., Manku-Scott T. Comparison of video-recorded consultations with those in which patients' consent is withheld. Br J Gen Pract 1998, 48:971-974.
16. McCambridge J., Kypri K., Elbourne D. Research participation effects: a skeleton in the methodological cupboard. J Clin Epidemiol 2014, 67:845-849.
17. Merrett F. Reflections on the Hawthorne Effect. Educ Psychol 2006, 26:143-146.
18. Campbell L.M., Sullivan F., Murray T.S. Videotaping of general practice consultations: effect on patient satisfaction. Brit Med J. 1995, 311:236.
19. Ram P., Grol R., Rethans J.J., Schouten B., van der Vleuten C., Kester A. Assessment of general practitioners by video observation of communicative and medical performance in daily practice: issues of validity, reliability and feasibility. Med Educ 1999, 33:447-454.
20. Herzmark G. Reactions of patients to video recording of consultations in general practice. Br Med J (Clin Res Ed) 1985, 291:315-317.
21. Hargreaves P.N., Peppiatt R. Is videotaping of consultations acceptable to patients attending a hospice day centre. Palliat Med 2001, 15:49-54.
22. Kravitz R.L., Franks P., Feldman M.D., Tancredi D.J., Slee C.A., Epstein R.M., et al. Patient engagement programs for recognition and initial treatment of depression in primary care: a randomized trial. J Amer Med Assoc 2013, 310:1818-1828.
23. Kroenke K., Strine T.W., Spitzer R.L., Williams J.B.W., Berry J.T., Mokdad A.H. The PHQ-8 as a measure of current depression in the general population. J Affect Disord 2009, 114:163-173.
24. Tancredi D.J., Slee C.K., Jerant A., Franks P., Nettiksimmons J., Cipri C., et al. Targeted versus tailored multimedia patient engagement to enhance depression recognition and treatment in primary care: randomized controlled trial protocol for the AMEP2 study. BMC Health Serv Res 2013, 13:141.
25. Kroenke K., Spitzer R.L., The P.H.Q-9. A new depression diagnostic and severity measure. Psychiat Ann 2002, 32:509-515.
26. Kroenke K., Spitzer R.L., Williams J.B. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001, 16:606-613.
27. Ware J., Kosinski M., Keller S.D. A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care 1996, 34:220-233.
28. Maly R.C., Frank J.C., Marshall G.N., DiMatteo M.R., Reuben D.B. Perceived efficacy in patient-physician interactions (PEPPI): validation of an instrument in older persons. J Am Geriatr Soc 1998, 46:889-894.
29. Miller A.J. Subset selection in regression 2002, 42-43. Chapman & Hall/CRC, Boca Raton. 2nd ed.
30. Hosmer D.W., Lemeshow S. Applied logistic regression 2000, 91-97. Wiley, New York. 2nd ed.
31. Fleishman J.A., Selim A.J., Kazis L.E. Deriving SF-12v2 physical and mental health summary scores: a comparison of different scoring algorithms. Qual Life Res 2010, 19:231-241.
32. McIver J.P., Carmines E.G. Unidimensional scaling 1981, Sage Publications, Beverly Hills.
33. D'Agostino R.B. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med 1998, 17:2265-2281.
34. Griswold M.E., Localio A.R., Mulrow C. Propensity score adjustment with multilevel data: setting your sites on decreasing selection bias. Ann Intern Med 2010, 152:393-395.
35. Rosenbaum P.R., Rubin D.B. The Central Role of the Propensity Score in Observational Studies for Causal Effects. Biometrika 1983, 70:41-55.
36. Lunceford J.K., Davidian M. Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study. Stat Med 2004, 23:2937-2960.
37. Austin P.C. The relative ability of different propensity score methods to balance measured covariates between treated and untreated subjects in observational studies. Med Decis Making 2009, 29:661-677.
38. Austin P.C., Grootendorst P., Anderson G.M. A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study. Stat Med 2007, 26:734-753.
39. White I.R., Royston P., Wood A.M. Multiple imputation using chained equations: issues and guidance for practice. Stat Med 2011, 30:377-399.
40. Cooper L.A., Roter D.L. Patient-provider communication: the effect of race and ethnicity on process and outcomes of healthcare. Institute of Medicine (U. S.). Committee on Understanding and Eliminating Racial and Ethnic Disparities in Health Care. Unequal treatment: confronting racial and ethnic disparities in health care 2003, 552-593. National Academy Press, Washington, DC. B.D. Smedley, A.Y. Stith, A.R. Nelson (Eds.).
41. Penner L.A., Orom H., Albrecht T.L., Franks M.M., Foster T.S., Ruckdeschel J.C. Camera-related behaviors during video recorded medical interactions. J Nonverbal Behav 2007, 31:99-117.
42. Zhou Y., Forbes G.M., Humphris G. Camera-related behaviours of female dental nurses and nursery school children during fluoride varnish application interactions in nursery school settings. Int J Paediatr Dent 2010, 20:374-381.
43. Pringle M., Stewart-Evans C. Does awareness of being video recorded affect doctors consultation behavior. Brit J Gen Pract 1990, 40:455-458.
44. Pringle M., Robins S., Brown G. Assessing the consultation: methods of observing trainees in general practice. Br Med J (Clin Res Ed) 1984, 288:1659-1660.
45. Mangione-Smith R., Elliott M.N., McDonald L., McGlynn E.A. An observational study of antibiotic prescribing behavior and the Hawthorne effect. Health Serv Res 2002, 37:1603-1623.
46. Leonard K., Masatu M.C. Outpatient process quality evaluation and the Hawthorne Effect. Soc Sci Med 2006, 63:2330-2340.
47. Henry S.G., Feng B., Franks P., Bell R.A., Tancredi D.J., Gottfeld D., et al. Methods for assessing patient-clinician communication about depression in primary care: what you see depends on how you look. Health Serv Res 2014, 49:1684-1700.
48. Makary M.A. The power of video recording: taking quality to the next level. J Amer Med Assoc 2013, 309:1591-1592.
49. Henry S.G., Holmboe E.S., Frankel R.M. Evidence-based competencies for improving communication skills in graduate medical education: a review with suggestions for implementation. Med Teach 2013, 35:395-403.
50. Tsulukidze M., Durand M.A., Barr P.J., Mead T., Elwyn G. Providing recording of clinical consultation to patients - a highly valued but underutilized intervention: a scoping review. Patient Educ Couns 2014, 95:297-304.
51. McCambridge J., Witton J., Elbourne D.R. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol 2014, 67:267-277.