A randomized experiment investigating the suitability of speech-enabled IVR and web modes for publicly reported surveys of patients' experience of hospital care

Medical Care Research and Review

Volumn 70, Issue 2, 2013, Pages 165-184

  Elliott, Marc N ^a   Brown, Julie A ^a   Lehrman, William G ^b   Beckett, Megan K ^a   Hambarsoomian, Katrin ^a   Giordano, Laura A ^c   Goldstein, Elizabeth H ^b  

^a RAND CORPORATION   (United States)

^b CENTERS FOR MEDICARE AND MEDICAID SERVICES   (United States)

^c Health Services Advisory Group   (United States)

Author keywords

HCAHPS; patient satisfaction; speech enabled IVR; web surveys

Indexed keywords

ADULT; AGED; AUTOMATIC SPEECH RECOGNITION; E-MAIL; ETHNIC DIFFERENCE; FEMALE; FOLLOW UP; HEALTH CARE; HOSPITAL CARE; HUMAN; MAJOR CLINICAL STUDY; MALE; MOBILE PHONE; PERSONAL EXPERIENCE; REVIEW; SOCIAL DESIRABILITY; STANDARDIZATION; WEB BROWSER;

ADOLESCENT; ADULT; AGED; AGED, 80 AND OVER; FEMALE; HEALTH CARE SURVEYS; HOSPITALS; HUMANS; INTERNET; INTERVIEWS AS TOPIC; MALE; MIDDLE AGED; PATIENT SATISFACTION; POSTAL SERVICE; SPEECH RECOGNITION SOFTWARE; TELEPHONE; YOUNG ADULT;

EID: 84875720943     PISSN: 10775587     EISSN: 15526801     Source Type: Journal    
DOI: 10.1177/1077558712464907     Document Type: Review

References (35)

1. Ball T., Bonnewell V., Danielsen P., Mataga P., Rehor K.. Speech-enabled services using TelePortal™ software and VoiceXML. Bell Labs Technical Journal. 2000 ; 5 (3). 98-111
2. Centers for Medicare & Medicaid Services. (2010, June13). HCAHPS fact sheet 2010. Retrieved from http://www.hcahpsonline.org/files/ HCAHPS%20Fact%20Sheet%202010.pdf
3. Centers for Medicare & Medicaid Services. (2012, September18). HCAHPS Quality Assurance Guidelines V7.0. Retrieved from http://www.hcahpsonline.org/ files/HCAHPS%20Quality%20Assurance%20Guidelines%20V7.0%20March%202012.pdf
4. Christian L. M., Dillman D. A., Smyth J. D. Advances in telephone survey methodology. Lepkowski J. Tucker C. Brick M. de Leeuw E. Japec L. Lavrakas P. Sangster R., ed. New York, NY: Wiley-Interscience ; 2008: 250-275.
5. Corkrey R., Parkinson L.. Interactive voice response: Review of studies 1989-2000. Behavioral Research Methods, Instruments, & Computers. 2002 ; 34: 342-353
6. Couper M.. Web surveys: A review of issues and approaches. Public Opinion Quarterly. 2000 ; 64: 464-494
7. Damiano P. C., Elliott M. N., Tyler M., Hays R. D.. Differential use of the CAHPS® 0-10 global gating scale by Medicaid and commercial populations. Health Services and Outcomes Research Methodology. 2004 ; 5 (3-4). 193-205
8. Davis R. E., Couper M. P., Janz N. K., Caldwell C. H., Resnicow K.. Interviewer effects in public health surveys. Health Education Research. 2010 ; 25 (1). 14-26
9. Dillman D. A., Phelps G., Tortora R., Swift K., Kohrell J., Berck J., Messer B. L.. Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the internet. Social Science Research. 2009 ; 38 (1). 3-20
10. Dulude L.. Automated telephone answering systems and aging. Behaviour & Information Technology. 2002 ; 21: 171-184
11. Elliott M. N., Haviland A. M., Kanouse D. E., Hambarsoomian K., Hays R. D.. Adjusting for subgroup differences in extreme response tendency in ratings of health care: impact on disparity estimates. Health Services Research. 2009 ; 44 (2). 542-561
12. Elliott M. N., Zaslavsky A. M., Goldstein E., Lehrman W., Hambarsoomians K., Beckett M. K., Giordano L.. Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores. Health Services Research. 2009 ; 44 (2). 501-518
13. Fowler F. J., Gallagher P. M., Stringfellow V. L., Zaslavsky A. M., Thompson J. W., Cleary P. D.. Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Medical Care. 2002 ; 40: 190-200
14. Giordano L. A., Elliott M. N., Goldstein E., Lehrman W. G., Spencer P. A.. Development, implementation, and public reporting of the HCAHPS survey. Medical Care Research and Review. 2010 ; 67: 27-37
15. Goldstein E., Elliott M. N., Lehrman W. G., Hambarsoomian K., Giordano L. A.. Racial/ethnic differences in patients' perceptions of inpatient care using the HCAHPS survey. Medical Care Research and Review. 2010 ; 67: 74-92
16. Goldstein E., Farquhar M., Crofton C., Darby C., Garfinkel S.. Measuring hospital care from the patients' perspective: An overview of the CAHPS hospital survey development process. Health Services Research. 2005 ; 40 (6). 1977-1995
17. Griffin D. H., Obenski S. M. Meeting 21st century demographic needs implementing the American Community Survey: May 2002, Report 2: Demonstrating survey quality. Washington, DC: U.S. Department of Commerce, Economics, and Statistics ; 2002 :
18. Kaplowitz M. D., Hadlock T. D., Levine R.. A comparison of web and mail survey response rates. Public Opinion Quarterly. 2004 ; 68: 94-101
19. Kennedy J. M., Kuh G., Carini R... Paper presented at the annual meeting of the American Association for Public Opinion Research ; 2000 Portland, OR ; 2000..
20. Klingner J., Tversky B., Hanrahan P.. Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks. Psychophysiology. 2011 ; 48: 323-332
21. Krosnick J. A., Alwin D. F.. An evaluation of a cognitive theory of response-order effects in survey measurement. Public Opinion Quarterly. 1987 ; 51: 201-219
22. Krysan M., Schuman H., Scott L. J., Beatty P.. Response rates and response content in mail versus face-to-face surveys. Public Opinion Quarterly. 1994 ; 58: 381-399
23. Link M., Mokdad A.. Use of alternative modes for health surveillance surveys: Results from a web/mail/telephone experiment. Epidemiology. 2005 ; 16: 701-704
24. Miller D. I., Bruce H., Gagnon M., Talbot V., Messier C.. Improving older adults' experience with interactive voice response systems. Telemedicine and e-Health. 2011 ; 17: 452-455
25. Rodriguez H. P., von Glahn T., Rogers W. H., Chang H., Fanjiang G., Safran D. G.. Evaluating patients' experiences with individual physicians: A randomized trial of mail, internet, and interactive voice response telephone administration of surveys. Medical Care. 2006 ; 44: 167-174
26. Rogers S. M., Miller H. G., Turner C. F.. Effects of interview mode on bias in survey measurements of drug use: Do respondent characteristics make a difference?. Substance Use & Misuse. 1998 ; 33: 2179-2200
27. Schneider S. J., Cantor D., Heller T. H., Brick P. D... Paper presented at the International Conference on Questionnaire Development, Evaluation, and Testing Methods ; 2002 Charleston, SC ; 2002..
28. Shettle C., Mooney G.. Monetary incentives in U.S. government surveys. Journal of Official Statistics. 1999 ; 15: 231-250
29. Tarnai J., Dillman D. A. Context effects in social and psychological research. Schwarz N. Hippler H. J. Sudman S., ed. New York, NY: Springer-Verlag ; 1992: 115-130.
30. Toepoel V., Das M., Soest A.. Effects of design in web Surveys: Comparing trained and fresh respondents. Public Opinion Quarterly. 2009 ; 72: 985-1007
31. Tourangeau R., Steiger D. M., Wilson D.. Self-administered questions by telephone - Evaluating interactive voice response. Public Opinion Quarterly. 2002 ; 66: 265-278
32. Tourkin S., Cox S., Parmer R., Zukerberg A... Paper presented at the American Association for Public Opinion Research Conference ; 2005 Miami, FL ; 2005..
33. Turner C. F., Forsyth B. H., O'Reilly J., Cooley P. C., Smith T. K., Rogers S. M., Miller H. Computer-assisted survey information collection. Couper M. P. Baler R. P. Bethlehem J. Clark C. Z. Martin J. Nicholls W. O'Reilly J. M., ed. New York, NY: Wiley ; 1998: 455-473.
34. Weech-Maldonado R., Elliott M. N., Oluwole A., Schiller K. C., Hays R. D.. Survey response style and differential use of CAHPS rating scales by Hispanics. Medical Care. 2008 ; 46: 963-968
35. Ziegenfuss J. Y., Beebe T. J., Rey E., Schleck C., Locke G. R., Talley N. J.. Internet option in a mail survey: More harm than good?. Epidemiology. 2010 ; 21: 585-586