A framework for understanding modifications to measures for diverse populations

Journal of Aging and Health

Volumn 24, Issue 6, 2012, Pages 992-1017

  Stewart, Anita L ^a   Thrasher, Angela D ^b   Goldberg, Jack ^c   Shea, Judy A ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b The University of North Carolina at Chapel Hill   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

^d UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

adapting measures; health disparities; measurement; minority aging; modifying measures

Indexed keywords

AGED; AGING; ARTICLE; ETHNIC GROUP; ETHNOLOGY; HEALTH DISPARITY; HUMAN; MEDICAL RESEARCH; METHODOLOGY; MINORITY GROUP; PRACTICE GUIDELINE; REPRODUCIBILITY; SELF REPORT; SOCIOECONOMICS; VULNERABLE POPULATION;

AGED; AGING; BIOMEDICAL RESEARCH; ETHNIC GROUPS; GUIDELINES AS TOPIC; HEALTH STATUS DISPARITIES; HUMANS; MINORITY GROUPS; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; SELF REPORT; SOCIOECONOMIC FACTORS; VULNERABLE POPULATIONS;

EID: 84865213465     PISSN: 08982643     EISSN: 15526887     Source Type: Journal    
DOI: 10.1177/0898264312440321     Document Type: Article

References (91)

1. Aaronson N. K., Acquadro C., Alonso J., Apolone G., Bucquet D., Bullinger M.,... Ware J. E.. International Quality of Life Assessment (IQOLA) project. Quality of Life Research. 1992 ; 1: 349-351
2. Aroian K. J., Hough E. S., Templin T. N., Kaskiri E. A.. Development and psychometric evaluation of an Arab version of the Family Peer Relationship Questionnaire. Research in Nursing and Health. 2008 ; 31: 402-416
3. Bachman J. G., O'Malley P. M.. Yea-saying, nay-saying, and going to extremes: Black-white differences in response style. Public Opinion Quarterly. 1984 ; 48: 491-509
4. Beaton D. E., Bombardier C., Guillemin F., Ferraz M. B.. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000 ; 25: 3186-3191 (Pubitemid 32042951)
5. Beck A. T., Steer R. A., Garbin M. G.. Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review. 1988 ; 8: 77-100 (Pubitemid 18045797)
6. Bild D. E., Bluemke D. A., Burke G. L., Detrano R., Diez Roux A. V., Folsom A. R.,... Tracy R. P.. Multi-ethnic study of atherosclerosis: Objectives and design. American Journal of Epidemiology. 2002 ; 156: 871-881 (Pubitemid 35215769)
7. Bird S. T., Bogart L. M.. Perceived race-based and socioeconomic status (SES)-based discrimination in interactions with health care providers. Ethnicity and Disease. 2001 ; 11: 554-563 (Pubitemid 33584378)
8. Bullinger M., Alonso J., Apolone G., Leplege A., Sullivan M., Wood-Dauphinee S.,... Ware J. E.. Translating health status questionnaires and evaluating their quality: The IQOLA Project approach. Journal of Clinical Epidemiology. 1998 ; 51: 913-923 (Pubitemid 28527146)
9. Chapleski E. E., Lamphere J. K., Kaczynski R., Lichtenberg P. A., Dwyer J. W.. Structure of a depression measure among American Indian elders: Confirmatory factor analysis of the CES-D scale. Research on Aging. 1997 ; 19: 462-485 (Pubitemid 27509866)
10. Chatters L. M., Taylor R. J., Lincoln K. D.. Advances in the measurement of religiosity among older African Americans: Implications for health and mental health researchers. Journal of Mental Health and Aging. 2001 ; 7: 180-200
11. Coates R. J., Monteilh C. P.. Assessments of food-frequency questionnaires in minority populations. American Journal of Clinical Nutrition. 1997 ; 65: 1108-1115
12. Collins D.. Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research. 2003 ; 12: 229-238 (Pubitemid 36549531)
13. Coons S. J., Gwaltney C. J., Hays R. D., Lundy J. J., Sloan J. A., Revicki D. A.,... Basch E.. Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO good research practices task force report. Value Health. 2009 ; 12: 419-429
14. Dixon J. S., Bird H. A.. Reproducibility along a 10 cm vertical visual analogue scale. Annals of the Rheumatic Diseases. 1981 ; 40: 87-89 (Pubitemid 11153077)
15. Drennan J.. Cognitive interviewing: Verbal data in the design and pretesting of questionnaires. Journal of Advanced Nursing. 2003 ; 42: 57-63 (Pubitemid 37255936)
16. Dupuy H. J. Assessment of quality of life in clinical trials of cardiovascular therapies. Wenger N. K. Mattson M. D. Furberg C. D. Elinson J., ed. New York: Le Jacq Publishing, Inc ; 1984: 170-83.
17. Floyd M. F., Taylor W. C., Whitt-Glover M.. Measurement of park and recreation environments that support physical activity in low-income communities of color: Highlights of challenges and recommendations. American Journal of Preventive Medicine. 2009 ; 36: 156-160
18. Fongwa M. N., Hays R. D., Gutierrez P. R., Stewart A. L.. Psychometric characteristics of a patient satisfaction instrument tailored to the concerns of African Americans. Ethnicity and Disease. 2006 ; 16: 948-955
19. Using focus groups to adapt survey instruments to new populations. Fuller T. D. Edwards J. N. Vorakitphokatorn S Sermsri S., ed. Newbury Park, CA: Sage ; 1993 :
20. González V. M., Stewart A., Ritter P. L., Lorig K.. Translation and validation of arthritis outcome measures into Spanish. Arthritis and Rheumatism. 1995 ; 38: 1429-1446
21. Gregorich S. E.. Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care. 2006 ; 44: 78-94
22. Hahn E. A., Cella D.. Health outcomes assessment in vulnerable populations: Measurement challenges and recommendations. Archives of Physical Medicine and Rehabilitation. 2003 ; 84: 35-42
23. Hahn E. A., Cella D., Dobrez D., Shiomoto G., Marcus E., Taylor S. G.,... Webster K.. The talking touchscreen: A new approach to outcomes assessment in low literacy. Psycho-Oncology. 2004 ; 13: 86-95 (Pubitemid 38247765)
24. Hausmann L. R., Kressin N. R., Hanusa B. H., Ibrahim S. A.. Perceived racial discrimination in health care and its association with patients' healthcare experiences: Does the measure matter?. Ethnicity and Disease. 2010 ; 20: 40-47
25. Hays R. D., Hahn H., Marshall G.. Use of the SF-36 and other health-related quality of life measures to assess persons with disabilities. Archives of Physical Medicine and Rehabilitation. 2002 ; 83: S4-9
26. Hughes D., DuMont K.. Using focus groups to facilitate culturally anchored research. American Journal of Community Psychology. 1993 ; 21: 775-806
27. Hui C. H., Triandis H. C.. Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology. 1989 ; 20: 296-309
28. Jackson J. S. Handbook of tests and measurements for black populations. Jones R. L., ed. Hampton, VA: Cobb & Henry ; 1996: 535-540.
29. Johnson T. P.. Methods and frameworks for crosscultural measurement. Medical Care. 2006 ; 44: S17-20
30. Juniper E. F.. Validated questionnaires should not be modified. European Respiratory Journal. 2009 ; 34: 1015-1017
31. Kazis L. E., Miller D. R., Clark J. A., Skinner K. M., Lee A., Ren X. S.,... Ware J. E.. Improving the response choices on the veterans SF-36 health survey role functioning scales: Results from the Veterans Health Study. Journal of Ambulatory Care Management. 2004 ; 27: 263-280 (Pubitemid 38780397)
32. Kazis L. E., Ren X. S., Lee A., Skinner K., Rogers W., Clark J., Miller D. R.. Health status in VA patients: Results from the Veterans Health Study. American Journal of Medical Quality. 1999 ; 14: 28-38
33. Krause N.. The use of qualitative methods to improve quantitative measures of health-related constructs. Medical Care. 2006 ; 44: S34-38
34. Krause N., Markides K.. Measuring social support among older adults. International Journal of Aging and Human Development. 1990 ; 30: 37-53 (Pubitemid 20096894)
35. Martinez N. C., Sousa V. D.. Cross-cultural validation and psychometric evaluation of the Spanish Brief Religious Coping Scale (S-BRCS). Journal of Transcultural Nursing. 2011 ; 22: 248-256
36. Masse L. C., Ainsworth B. E., Tortolero S., Levin S., Fulton J. E., Henderson K. A., Mayo K.. Measuring physical activity in midlife, older, and minority women: Issues from an expert panel. Journal of Womens Health. 1998 ; 7: 57-67
37. Mattson-Prince J.. A rational approach to long-term care: Comparing the independent living model with agency-based care for persons with high spinal cord injuries. Spinal Cord. 1997 ; 35: 326-331 (Pubitemid 27235049)
38. Mayer-Davis E. J., Vitolins M. Z., Carmichael S. L., Hemphill S., Tsaroucha G., Rushing J., Levin S.. Validity and reproducibility of a food frequency interview in a multi-cultural epidemiology study. Annals of Epidemiology. 1999 ; 9: 314-324 (Pubitemid 29289846)
39. McDowell I. Y., Newell C. Measuring health: A guide to rating scales and questionnaires. 2006 ). Measuring health: A guide to rating scales and questionnaires (3rd ed.). New York, NY: Oxford University Press. New York, NY: Oxford University Press ; 2006 :
40. Messick S.. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist. 1995 ; 50: 741-749
41. Meyers A. R., Andresen E. M.. Enabling our instruments: Accommodation, universal design, and access to participation in research. Archives of Physical Medicine and Rehabilitation. 2000 ; 81: S5-9
42. Moody-Ayers S. Y., Stewart A. L., Covinsky K. E., Inouye S. K.. Prevalence and correlates of perceived societal racism in older African American adults with type 2 diabetes mellitus. Journal of the American Geriatrics Society. 2005 ; 53: 2202-2208 (Pubitemid 43001206)
43. Mui A. C., Burnette D., Chen L. M.. Cross-cultural assessment of geriatric depression: A review of the CES-D and the GDS. Journal of Mental Health and Aging. 2001 ; 7: 137-164 (Pubitemid 32381732)
44. Mullin P. A., Lohr K. N., Bresnahan B. W., McNulty P.. Applying cognitive design principles to formatting HRQOL instruments. Quality of Life Research. 2000 ; 9: 13-27 (Pubitemid 30670646)
45. Murray-Garcia J. L., Selby J. V., Schmittdiel J., Grumbach K., Quesenberry C. P.. Racial and ethnic differences in a patient survey: Patients' values, ratings, and reports regarding physician primary care performance in a large health maintenance organization. Medical Care. 2000 ; 38: 300-310
46. Mutran E. J., Reed P. S., Sudha S.. Social support: clarifying the construct with applications for minority populations. Journal of Mental Health and Aging. 2001 ; 7: 67-78 (Pubitemid 32381728)
47. Nápoles-Springer A. M., Santoyo-Olsson J., Farren G., Olmstead J., Cabral R., Ross B.,... Stewart A. L.. The patient-reported Clinicians' Cultural Sensitivity Survey: A field test among older Latino primary care patients. Health Expectations. 2012 ; 15: 63-77
48. Nápoles-Springer A. M., Ortiz C., O'Brien H., Sereno A. B., Kaplan C. P.. Coping resources and self-rated health among latina breast cancer survivors. Oncology Nursing Forum. 2011 ; 38: 523-531
49. Nápoles-Springer A. M., Santoyo-Olsson J., Houston K., Perez-Stable E. J., Stewart A. L.. Patients' perceptions of cultural factors affecting the quality of their medical encounters. Health Expectations. 2005 ; 8: 4-17 (Pubitemid 40343313)
50. Nápoles-Springer A. M., Santoyo-Olsson J., O'Brien H., Stewart A. L.. Using cognitive interviews to develop surveys in diverse populations. Medical Care. 2006 ; 44: S21-30
51. Nápoles-Springer A. M., Stewart A. L.. Overview of qualitative methods in research with diverse populations: Making research reflect the population. Medical Care. 2006 ; 44 (Suppl. 3). 5-9
52. National Institute on Aging. (2011). Health disparities strategic plan: Fiscal years 2009-2013. Baltimore, MD: Author.
53. Ngo-Metzger Q., Legedza A. T., Phillips R. S.. Asian Americans' reports of their health care experiences. Results of a national survey. Journal of General Internal Medicine. 2004 ; 19: 111-119 (Pubitemid 38368459)
54. Nunnally J. C., Bernstein I. H. Psychometric theory. 1994 ). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill. New York, NY: McGraw-Hill ; 1994 :
55. Ploughman M., Austin M., Stefanelli M., Godwin M.. Applying cognitive debriefing to pre-test patient-reported outcomes in older people with multiple sclerosis. Quality of Life Research. 2010 ; 19: 483-487
56. Resnicow K., McCarty F., Blissett D., Wang T., Heitzler C., Lee R. E.. Validity of a modified CHAMPS physical activity questionnaire among African-Americans. Medicine and Science in Sports and Exercise. 2003 ; 35: 1537-1545 (Pubitemid 37087584)
57. Rosal M. C., Carbone E. T., Goins K. V.. Use of cognitive interviewing to adapt measurement instruments for low-literate Hispanics. Diabetes Educator. 2003 ; 29: 1006-1017 (Pubitemid 38333425)
58. Rudkin L., Markides K. S.. Measuring the socioeconomic status of elderly people in health studies with special focus on minority elderly. Journal of Mental Health and Aging. 2001 ; 7: 53-66 (Pubitemid 32381727)
59. Salant T., Lauderdale D. S.. Measuring culture: A critical review of acculturation and health in Asian immigrant populations. Social Science and Medicine. 2003 ; 57: 71-90 (Pubitemid 36566519)
60. Santoyo-Olsson J., Cabrera J., Freyre R., Grossman M., Alvarez N., Mathur D.,... Stewart A. L.. An innovative multiphased strategy to recruit underserved adults into a randomized trial of a community-based diabetes risk reduction program. Gerontologist. 2011 ; 51 (Suppl. 1). 82-93
61. Sechrest L.. Validity of measures is no simple matter. Health Services Research. 2005 ; 40: 1584-1604 (Pubitemid 41434349)
62. Selman L., Harding R., Gysels M., Speck P., Higginson I. J.. The measurement of spirituality in palliative care and the content of tools validated cross-culturally: A systematic review. Journal of Pain and Symptom Management. 2011 ; 41 (4). 728-753
63. Sentell T. L., Ratcliff-Baird B.. Literacy and comprehension of Beck Depression Inventory response alternatives. Community Mental Health Journal. 2003 ; 39: 323-331 (Pubitemid 38076676)
64. Shea J. A., Aguirre A. C., Sabatini J., Weiner J., Schaffer M., Asch D. A.. Developing an illustrated version of the Consumer Assessment of Health Plans (CAHPS). Joint Commission Journal on Quality and Patient Safety. 2005 ; 31: 32-42
65. Shea J. A., Guerra C. E., Weiner J., Aguirre A. C., Ravenell K. L., Asch D. A.. Adapting a patient satisfaction instrument for low literate and Spanish-speaking populations: Comparison of three formats. Patient Education and Counseling. 2008 ; 73: 132-140
66. Skinner J. H.. Acculturation: Measures of ethnic accommodation to the dominant American culture. Journal of Mental Health and Aging. 2001 ; 7: 41-52 (Pubitemid 32381726)
67. Unequal treatment: Confronting racial and ethnic disparities in health care. Smedley B. D. Stith A. Y. Nelson A. R., ed. Washington, DC: The National Academies Press ; 2003 :
68. Stahl S. M., Hahn A. A.. The National Institute on Aging's Resource Centers for Minority Aging Research. Contributions to measurement in research on ethnically and racially diverse populations. Medical Care. 2006 ; 44: 1-2
69. Stewart A. L., Mills K. M., King A. C., Haskell W. L., Gillis D., Ritter P. L.. CHAMPS physical activity questionnaire for older adults: Outcome for interventions. Medicine and Science in Sports and Exercise. 2001 ; 33: 1126-1141 (Pubitemid 32641313)
70. Stewart A. L., Nápoles-Springer A.. Health-related quality of life assessments in diverse population groups in the United States. Medical Care. 2000 ; 38: II102-124
71. Stewart A. L., Nápoles-Springer A. M.. Advancing health disparities research: Can we afford to ignore measurement issues?. Medical Care. 2003 ; 41: 1207-1220
72. Stewart A. L., Nápoles-Springer A. M., Gregorich S. E., Santoyo-Olsson J.. Interpersonal processes of care survey: Patient-reported measures for diverse groups. Health Services Research. 2007 ; 42: 1235-1256 (Pubitemid 46699467)
73. Measuring functioning and well-being: The medical outcomes study approach. Stewart A. L. Ware J. E., ed. Durham, NC: Duke University Press ; 1992 :
74. Stone A. A., Turkkan J. S., Bachrach C. A., Jobe J. B., Kurtzman H. S., Cain V. S. The science of self-report: Implications for research and practice. Mahwah, NJ: Lawrence Erlbaum ; 2000 :
75. Taira D. A., Safran D. G., Seto T. B., Rogers W. H., Kosinski M., Ware J. E.,... Tarlov A. R.. Asian-American patient ratings of physician primary care performance. Journal of General Internal Medicine. 1997 ; 12: 237-242 (Pubitemid 27175898)
76. Teng E. L., Chui H. C.. The Modified Mini-Mental State (3MS) examination. Journal of Clinical Psychiatry. 1987 ; 48: 314-318 (Pubitemid 17138128)
77. Teresi J. A., Stewart A. L., Morales L., Stahl S.. Measurement in a multi-ethnic society: Overview to the special issue. Medical Care. 2006 ; 44 (Suppl. 3). 2-3
78. Thiamwong L., Stewart A. L., Warahut J.. Development, reliability and validity of the Thai Healthy Aging Survey. Walailak Journal of Science and Technology. 2009 ; 6: 167-188
79. Tobin M. J.. Authors, authors, authors-follow instructions or expect delay. American Journal of Respiratory and Critical Care Medicine. 2000 ; 162: 1193-1194
80. Tucker K. L., Bianchi L. A., Maras J., Bermudez O. I.. Adaptation of a food frequency questionnaire to assess diets of Puerto Rican and non-Hispanic adults. American Journal of Epidemiology. 1998 ; 148: 507-518 (Pubitemid 28411108)
81. Healthy people 2010. Washington, DC: Author ; 2000 :
82. Vanderplas J. H., Vanderplas J. M.. Effects of legibility on verbal test performance of older adults. Perceptual and Motor Skills. 1981 ; 53: 183-186
83. Vogt D. S., King D. W., King L. A.. Focus groups in psychological assessment: Enhancing content validity by consulting members of the target population. Psychological Assessment. 2004 ; 16: 231-243 (Pubitemid 39244708)
84. Walter M. J., Castro M., Kunselman S. J., Chinchilli V. M., Reno M., Ramkumar T. P.,... Wechsler M. E.. Predicting worsening asthma control following the common cold. European Respiratory Journal. 2008 ; 32: 1548-1554
85. Ware J. E.. SF-36 health survey update. Spine. 2000 ; 25: 3130-3139 (Pubitemid 32042945)
86. Warnecke R. B., Johnson T. P., Chaavez N., Sudman S., O'Rourke D. P., Lacey L., Horm J.. Improving question wording in surveys of culturally diverse populations. Annals of Epidemiology. 1997 ; 7: 334-342 (Pubitemid 27327253)
87. Weidmer-Ocampo B., Johansson P., Dalpoas D., Wharton D., Darby C., Hays R. D.. Adapting CAHPS for an American Indian population. Journal of Health Care for the Poor and Underserved. 2009 ; 20: 695-712
88. Weiner J., Aguirre A., Ravenell K., Kovath K., McDevit L., Murphy J.,... Shea J. A.. Designing an illustrated patient satisfaction instrument for low-literacy populations. The American Journal of Managed Care. 2004 ; 10: 853-860
89. Willis G. B. Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage ; 2005 :
90. Wong S. T., Yoo G. J., Stewart A. L.. Examining the types of social support and the actual sources of support in older Chinese and Korean immigrants. International Journal of Aging and Human Development. 2005 ; 61: 105-121 (Pubitemid 40994075)
91. Wong S. T., Yoo G. J., Stewart A. L.. An empirical evaluation of social support and psychological well-being in older Chinese and Korean immigrants. Ethnicity & Health. 2007 ; 12: 43-67 (Pubitemid 44846994)