Developing a patient-centered outcome measure for complementary and alternative medicine therapies II: Refining content validity through cognitive interviews

BMC Complementary and Alternative Medicine

Volumn 11, Issue , 2011, Pages

  Thompson, Jennifer J ^a   Kelly, Kimberly L ^b,c   Ritenbaugh, Cheryl ^b,c   Hopkins, Allison L ^b   Sims, Colette M ^b   Coons, Stephen J ^d  

^a UNIVERSITY OF GEORGIA   (United States)

^b UNIVERSITY OF ARIZONA COLLEGE OF MEDICINE   (United States)

^c UNIVERSITY OF ARIZONA   (United States)

^d Patient Reported Outcome Consortium   (United States)

Author keywords

Cognitive interviewing; Complementary and alternative medicine (CAM); Non specific outcomes; Patient centered care; Patient reported outcomes (PROs); Questionnaire development; Retrospective pre test; Well being

Indexed keywords

ALTERNATIVE MEDICINE; ARTICLE; CLINICAL ASSESSMENT TOOL; COGNITION; CONTENT VALIDITY; HUMAN; INTERVIEW; NOMENCLATURE; OUTCOME ASSESSMENT; PATIENT ADVOCACY; SELF ASSESSMENT OF CHANGE; ADOLESCENT; ADULT; AGED; COHORT ANALYSIS; EVALUATION; FEMALE; LANGUAGE; MALE; METHODOLOGY; MIDDLE AGED; PATIENT; PSYCHOLOGICAL ASPECT; QUESTIONNAIRE; SELF EVALUATION;

ADOLESCENT; ADULT; AGED; COGNITION; COHORT STUDIES; COMPLEMENTARY THERAPIES; FEMALE; HUMANS; INTERVIEWS AS TOPIC; LANGUAGE; MALE; MIDDLE AGED; OUTCOME ASSESSMENT (HEALTH CARE); PATIENTS; QUESTIONNAIRES; SELF-ASSESSMENT; YOUNG ADULT;

EID: 84855161767     PISSN: None     EISSN: 14726882     Source Type: Journal    
DOI: 10.1186/1472-6882-11-136     Document Type: Article

References (40)

1. Schulman D. The Unexpected Outcomes of Acupuncture: Case Reports in Support of Refocusing Research Designs. The Journal of Alternative and Complementary Medicine 2004, 10(5):785-789.
2. Bell IR, Koithan M, Gorman MM, Baldwin CM. Homeopathic Practitioner Views of Changes in Patients Undergoing Constitutional Treatment for Chronic Disease. The Journal of Alternative and Complementary Medicine 2003, 9(1):39-50. 10.1089/107555303321222937, 12676034.
3. Gould A, MacPherson H. Patient Perspectives on Outcomes After Treatment with Acupuncture. The Journal of Alternative and Complementary Medicine 2001, 7(3):261-268. 10.1089/107555301300328133, 11439847.
4. Paterson C, Britten N. Acupuncture for people with chronic illness: combining qualitative and quantitative outcome assessment. The Journal of Alternative and Complementary Medicine 2003, 9(5):671-681. 10.1089/107555303322524526, 14629845.
5. Mulkins AL, Verhoef MJ. Supporting the transformative process: experiences of cancer patients receiving integrative care. Integrative Cancer Therapies 2004, 3(3):230-237. 10.1177/1534735404268054, 15312264.
6. Paterson C, Britten N. Acupuncture as a complex intervention: a holistic model. The Journal of Alternative and Complementary Medicine 2004, 10(5):791-801.
7. Verhoef MJ, Mulkins A, Boon H. Integrative health care: how can we determine whether patients benefit?. The Journal of Alternative and Complementary Medicine 2005, 11(Suppl 1):S57-65.
8. Elder C, Ritenbaugh C, Mist S, Aickin M, Schneider J, Zwickey H, Elmer P. Randomized trial of two mind-body interventions for weight-loss maintenance. The Journal of Alternative and Complementary Medicine 2007, 13(1):67-78. 10.1089/acm.2006.6237, 17309380.
9. Koithan M, Verhoef M, Bell IR, White M, Mulkins A, Ritenbaugh C. The process of whole person healing: "unstuckness" and beyond. The Journal of Alternative and Complementary Medicine 2007, 13(6):659-668. 10.1089/acm.2007.7090, 17718649.
10. White MA, Verhoef MJ, Davison BJ, Gunn H, Cooke K. Seeking Mind, Body and Spirit Healing-Why Some Men with Prostate Cancer Choose CAM (Complementary and Alternative Medicine) over Conventional Cancer Treatments. Integrative Medicine Insights 2008, 3:1-11. 3046021, 21614154.
11. Hsu C, Bluespruce J, Sherman K, Cherkin D. Unanticipated benefits of CAM therapies for back pain: an exploration of patient experiences. The Journal of Alternative and Complementary Medicine 2010, 16(2):157-163. 10.1089/acm.2009.0188, 3110102, 20180688.
12. Ritenbaugh C, Nichter M, Nichter M, Kelly K, Sims C, Bell I, Casteneda H, Elder C, Koithan M, Sutherland E, et al. Developing a Patient-Centered Outcome Measure for Complementary and Alternative Medicine Therapies: I. Defining Content and Format. BMC Complementary and Alternative Medicine 2011, 11:135. 10.1186/1472-6882-11-135, 3293761, 22206345.
13. FDA Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. 2009, US Department of Helth and Human Services. Washington, DC, accessed August 2, 2012, FDA., http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM193282.pdf
14. Eton DT, Bauer BA, Sood A, Yost KJ, Sloan JA. Patient-Reported Outcomes in Studies of Complementary and Alternative Medicine: Problems, Solutions, and Future Directions. EXPLORE: The Journal of Science and Healing 2011, 7(5):314-319.
15. Drennan J, Hyde A. Controlling response shift bias: the use of the retrospective pre-test design in the evaluation of a master's programme. Assessment and Evaluation in Higher Education 2008, 33(6):699-709.
16. Howard GS. Response-shift bias: A problem in evaluating interventions with pre/post self-reports. Evaluation Review 1980, 4(1):93-106.
17. Rockwell SK, Kohn H. Post-Then-Pre Evaluation: Measuring behavior change more accurately. Journal of Extension 1989, 27(2). Accessed July 29, 2011., http://www.joe.org/joe/1989summer/a5.php
18. Program Development and Evaluation Using the Retrospective Post-then-Pre Design, Quick Tips #27. 2003, University of Wisconsin-Extension. Madison, WI, accessed 7/29/2011, Program Development and Evaluation., http://www.uwex.edu/ces/pdande/resources/index.html
19. Willis GB. Cognitive Interviewing: A Tool for Improving Questionnaire Design. 2005, Sage.
20. Renberg T, Kettis Lindblad T, Tully MP. Testing the validity of a translated pharmaceutical therapy-related quality of life instrument, using qualitative 'think aloud' methodology. Journal of Clinical Pharmacy and Therapeutics 2008, 33(3):279-287. 10.1111/j.1365-2710.2008.00921.x, 18452415.
21. Drennan J. Cognitive interviewing: verbal data in the design and pretesting of questionnaires. Journal of Advanced Nursing 2003, 42(1):57-63. 10.1046/j.1365-2648.2003.02579.x, 12641812.
22. Brod M, Tesler L, Christensen T. Qualitative research and content validity: developing best practices based on science and experience. Quality of Life Research 2009, 18(9):1263-1278. 10.1007/s11136-009-9540-9, 19784865.
23. Nicklin J, Cramp F, Kirwan J, Urban M, Hewlett S. Collaboration with patients in the design of patient-reported outcome measures: Capturing the experience of fatigue in rheumatoid arthritis. Arthritis Care & Research 2010, 62(11):1552-1558. 10.1002/acr.20264, 22213744.
24. Beatty PC, Willis GB. Research Synthesis: The Practice of Cognitive Interviewing. Public Opinion Quarterly 2007, 71(2):287-311.
25. Willis GB. Cognitive interviewing: A ''how to'' guide. 1999, National Cancer Institute., http://appliedresearch.cancer.gov/areas/cognitive/interview.pdf
26. Irwin DE, Varni JW, Yeatts K, DeWalt DA. Cognitive interviewing methodology in the development of a pediatric item bank: a patient reported outcomes measurement information system (PROMIS) study. Health Quality of Life Outcomes 2009, 7:3.
27. Eisner EW. The Enlightened Eye: Qualitative inquiry and the enhancement of educational practice. 1991, New York: Macmillan.
28. Morse JM. 'Perfectly healthy, but dead': The myth of inter-rater reliability. Qualitative Health Research 1997, 7:445.
29. Sandelowski M, Barroso J. Writing the proposal for a qualitative research methodology project. Qualitative Health Research 2003, 13(6):781-820. 10.1177/1049732303013006003, 12891715.
30. Bell IR, Caspi O, Schwartz GER, Grant KL, Gaudet TW, Rychener D, Maizes V, Weil A. Integrative medicine and systemic outcomes research - Issues in the emergence of a new model for primary health care. Archives of Internal Medicine 2002, 162(2):133-140. 10.1001/archinte.162.2.133, 11802746.
31. Smithson J, Britten N, Paterson C, Lewith G, Evans M. The experience of using complementary therapies after a diagnosis of cancer: A qualitative synthesis. Health: 2010,
32. Goedhart H, Hoogstraten J. The retrospective pretest and the role of pretest information in evaluative studies 1992, 70. Missoula, MT: Psychological Reports.
33. Lam TCM, Bengo P. A Comparison of Three Retrospective Self-reporting Methods of Measuring Change in Instructional Practice. American Journal of Evaluation 2003, 24(1):65-80.
34. Pratt CC, McGuigan WM, Katzev AR. Measuring Program Outcomes: Using Retrospective Pretest Methodology. American Journal of Evaluation 2000, 21(3):341-349.
35. Verhoef MJ, Vanderheyden LC, Dryden T, Mallory D, Ware MA. Evaluating complementary and alternative medicine interventions: in search of appropriate patient-centered outcome measures. BMC Complementary and Alternative Medicine 2006, 6:6-38. 10.1186/1472-6882-6-6, 1661594, 17118197.
36. Eton DT, Koffler K, Cella D, Eisenstein A, Astin JA, Pelletier KR, Riley D. Developing a self-report outcome measure for complementary and alternative medicine. Explore (NY) 2005, 1(3):177-185.
37. Paterson C. Measuring outcomes in primary care: a patient generated measure, MYMOP, compared with the SF-36 health survey. British Medical Journal 1996, 312(7037):1016-1020. 10.1136/bmj.312.7037.1016, 2350813, 8616351.
38. Bell IR, Cunningham V, Caspi O, Meek P, Ferro L. Development and validation of a new global well-being outcomes rating scale for integrative medicine research. BMC Complementary and Alternative Medicine 2004, 4(1):1. 10.1186/1472-6882-4-1, 343287, 14725717.
39. Kania A, Verhoef MJ, Dryden T, Ware MA. IN-CAM Outcomes Database: Its Relevance and Application in Massage Therapy Research and Practice. International Journal of Therapeutic Massage and Bodywork 2009, 2(1):8-16. 3091455, 21589721.
40. Rugg S, Paterson C, Britten N, Bridges J, Griffiths P. Traditional acupuncture for people with medically unexplained symptoms: a longitudinal qualitative study of patients experiences. British Journal of General Practice 2011, 61(587):e306-e315. 10.3399/bjgp11X577972, 21801509.