Differential item functioning in the short portable mental status questionnaire

Research on Aging

Volumn 27, Issue 3, 2005, Pages 355-384

  Stump, Timothy E ^a,b   Monahan, Patrick ^a,c   McHorney, Colleen A ^a  

^a INDIANA UNIVERSITY   (United States)

^b REGENSTRIEF INSTITUTE   (United States)

^c Roudebush Vet Aff Medical Center ^*

Author keywords

Cognitive impairment; Cognitive screening; Differential item functioning; Item bias; Logistic regression

Indexed keywords

ACADEMIC ACHIEVEMENT; ADULT; AFRICAN AMERICAN; AGED; ARTICLE; CAUCASIAN; COGNITION; COGNITIVE DEFECT; CONSULTATION; CONTROLLED STUDY; DATA ANALYSIS; DIFFERENTIAL ITEM FUNCTIONING; EDUCATION; FEMALE; HEALTH STATUS; HUMAN; MAJOR CLINICAL STUDY; MALE; MENTAL FUNCTION; MENTAL HEALTH; PRIMARY HEALTH CARE; QUESTIONNAIRE; RACE DIFFERENCE; SHORT PORTABLE MENTAL STATUS QUESTIONNAIRE;

EID: 17144415202     PISSN: 01640275     EISSN: None     Source Type: Journal    
DOI: 10.1177/0164027504273784     Document Type: Article

References (83)

1. Albert, Steven M., and Jeanne A. Teresi. 1999. "Reading Ability, Education, and Cognitive Status Assessment Among Older Adults in Harlem, New York City." American Journal of Public Health 89 (1): 95-7.
2. Allen, Nancy L., and John R. Donoghue. 1996. "Applying the Mantel-Haenszel Procedure to Complex Samples of Items." Journal of Educational Measurement 33 (2): 231-51.
3. Angoff, William H. 1993. "Perspectives on Differential Item Functioning Methodology." Pp. 3-23 in Differential Item Functioning edited by Paul W. Holland and Howard Wainer. Hillsdale, NJ: Lawrence Erlbaum.
4. Berkman, Lisa F., Teresa E. Seeman, Marilyn Albert, Dan Blazer, Robert Kahn, Richard Mohs, Caleb Finch, Edward Schneider, Carl Cotman, Gerald McClearn, John Nesselroade, David Featherman, Norman Garmezy, Guy McKhann, Gilbert Brim, Denis Prager, and John Rowe. 1993. "High, Usual and Impaired Functioning in Community-Dwelling Older Men and Women: Findings From the MacArthur Foundation Research Network on Successful Aging." Journal of Clinical Epidemiology 46 (10): 1129-40.
5. Cairl, Richard E., Eric Pfeiffer, Donald M. Keller, Henry Burke, and Harvey V. Samis. 1983. "An Evaluation of the Reliability and Validity of the Functional Assessment Inventory." Journal of the American Geriatrics Society 31 (1): 607-12.
6. Callahan, Christopher M., Hugh C. Hendrie, Robert S. Dittus, D. Craig Brater, Siu L. Hui, and William M. Tierney. 1994. "Improving Treatment of Late Life Depression in Primary Care: A Randomized Clinical Trial." Journal of the American Geriatrics Society 42:839-46.
7. Callahan, Christopher M., Hugh C. Hendrie, and William M. Tierney. 1995. "Documentation and Evaluation of Cognitive Impairment in Elderly Primary Care Patients." Annals of Internal Medicine 122:422-9.
8. Callahan, Christopher M., Siu L. Hui, Nancy Nienaber, Beverly Musick, and William M. Tierney. 1994. "Longitudinal Study of Depression and Health Services Use Among Elderly Primary Care Patients." Journal of the American Geriatrics Society 42:833-8.
9. Callahan, Christopher M., and William M. Tierney. 1995. "Health Services Use and Mortality Among Older Primary Care Patients With Alcoholism." Journal of the American Geriatrics Society 43 (12): 1378-83.
10. Camilli, Gregory, and Lorrie A. Shephard. 1994. Methods of Identifying Biased Test Items. Thousand Oaks, CA: Sage.
11. Collins, Williams C., Nambury S. Raju, and Jack E. Edwards. 2000. "Assessing Differential Functioning in a Satisfaction Scale." Journal of Applied Psychology 85 (3): 451-61.
12. Colsher, Patricia L., and Robert B. Wallace. 1989. "Data Quality and Age: Health and Psychobehavioral Correlates of Item Nonresponse and Inconsistent Responses." Journal of Gerontology 44 (2): 45-52.
13. Cornoni-Huntley, Joan C., Daniel J. Foley, Lon R. White, Richard Suzman, Lisa F. Berkman, Denis A. Evans, and Robert B. Wallace. 1985. "Epidemiology of Disability in the Oldest Old: Methodologic Issues and Preliminary Findings." Health and Society 63 (2): 350-76.
14. Dalaker, Joseph, and Bernadette D. Proctor. 2000. Poverty in the United States: 1999. Washington, DC: U.S. Government Printing Office.
15. Day, Jennifer Cheeseman. 1996. Population Projections of the United States by Age, Sex, Race, and Hispanic Origin: 1995 to 2050. Washington, DC: U.S. Government Printing Office.
16. Donoghue, John R., Paul W. Holland, and Dorothy T. Thayer. 1993. "A Monte Carlo Study of Factors That Affect the Mantel-Haenszel and Standardization Measures of Differential Item Functioning." Pp. 137-66 in Differential Item Functioning, edited by Paul W. Holland and Howard Wainer. Hillsdale, NJ: Lawrence Erlbaum.
17. Dorans, Neil J., and Paul W. Holland. 1993. "DIF Detection and Description: Mantel-Haenszel and Standardization." Pp. 35-66 in Differential Item Functioning, edited by Paul W. Holland and Howard Wainer. Hillsdale, NJ: Lawrence Erlbaum.
18. Drasgow, Fritz, and Robin I. Lissak. 1983. "Modified Parallel Analysis: A Procedure for Examining the Latent Dimensionality of Dichotomously Scored Item Responses." Journal of Applied Psychology 68 (3): 363-73.
19. duToit, Mathilde. 2003. IRT From SSI: BILOG-MG, MULTILOG, PARSCALE, TESTFACT. Lincolnwood, IL: Scientific Software International.
20. Escobar, Javier I., Audrey Burnam, Marvin Karno, Alan Forsythe, John Landsverk, and Jacqueline M. Golding. 1986. "Use of the Mini-Mental State Examination (MMSE) in a Community Population of Mixed Ethnicity: Cultural and Linguistic Artifacts." Journal of Nervous and Mental Disease 174:607-14.
21. Federal Communications Commission. 1995. Telephone Subscribers hip in the U.S. Washington, DC: Federal Communications Commission.
22. Fillenbaum, G. G., D. C. Hughes, A. Heyman, L. K. George, and D. G. Blazer. 1988. "Relationship of Health and Demographic Characteristics to Mini-Mental State Examination Score Among Community Residents." Psychological Medicine 18:719-26.
23. Folstein, Marshal, James C. Anthony, Irma Parhad, Bonnie Duffy, and Ernest M. Gruenberg. 1985. "The Meaning of Cognitive Impairment in the Elderly." Journal of the American Geriatrics Society 33 (4): 228-35.
24. Ford, Earl S. 1998. "Characteristics of Survey Participants With and Without a Telephone: Findings From the Third National Health and Nutrition Examination Survey." Journal of Clinical Epidemiology 51 (1): 55-60.
25. Gallo J. J., W. Reichel, and L. M. Anderson. 1995. Handbook of Geriatric Assessment, 2d ed. Rockville, MD: Aspen.
26. Garfein, Adam J., and A. Regula Herzog. 1995. "Robust Aging Among the Young-Old, Old-Old, and Oldest-Old." Journal of Gerontology 52B (2): M77-87.
27. Guarnaccia, P. J. 1996. "Anthropological Perspectives: The Importance of Culture in the Assessment of Quality of Life." Pp. 523-7 in Quality of Life and Pharmacoeconomics in Clinical Trials, 2d ed., edited by B. Spilker. Philadelphia: Lippincott-Raven.
28. Hambleton, Ronald K. 2001. "The Next Generation of the ITC Test Translation and Adaptation Guidelines." European Journal of Psychological Assessment 17 (3): 164-72.
29. Hambleton, Ronald K., Hariharan Swaminathan, and H. Jane Rogers. 1991. "Identification of Potentially Biased Test Items." Pp. 109-21 in Fundamentals of Item Response Theory, edited by R. K. Hambleton, H. Swaminathan, and H. J. Rogers. Newbury Park, CA: Sage.
30. Holland, Paul W., and Dorothy T. Thayer. 1988. "Differential Item Performance and the Mantel-Haenszel Procedure." Pp. 129-45 in Test Validity, edited by Howard Wainer and H. I. Braun. Hillsdale, NJ: Lawrence Erlbaum.
31. Hu, P. G., and Neil J. Dorans. 1989. The Effect of Deleting Items With Extreme Differential Item Functioning on Equating Functions and Reported Score Distributions. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
32. Hughes, Susan L., Frances M. Weaver, Anita Giobbie-Hurder, Larry Manheim, William Henderson, Joseph D. Kubal, Alec Ulasevich, and Joan Cummings. 2000. "Effectiveness of Team-Managed Home-Based Primary Care: A Randomized Multicenter Trial." Journal of the American Medical Association 284 (22): 2877-85.
33. Jones, R. N. 2003. "Racial Bias in the Assessment of Cognitive Functioning of Older Adults." Aging & Mental Health 1 (2): 83-102.
34. Jones, R. N., and Joseph J. Gallo. 2002. "Education and Sex Differences in the Mini-Mental State Examination: Effects of Differential Item Functioning." Journal of Gerontology 57B (6): P548-58.
35. Jöreskog, Karl G., and Dag Sörbom. 1996. LISREL 8: User's Reference Guide. Chicago: Scientific Software International.
36. Kittner, Steven J., Lon R. White, Mary E. Farmer, Mechael K. E. Wolz, Elisabeth B. J. A. Moes. and Manning Feinleib. 1986. "Methodological Issues in Screening for Dementia: The Problem of Education Adjustment." Journal of Chronic Diseases 39 (3): 163-70.
37. Langenfeld, Thomas E. 1997. "Test Fairness: Internal and External Investigations of Gender Bias in Mathematics Testing." Educational Measurement 16:20-6.
38. Launer, Lenore J., Annet W. Wind, and Dorly J. H. Deeg. 1994. "Nonresponse Pattern and Bias in a Community-Based Cross-Sectional Study of Cognitive Functioning Among the Elderly." American Journal of Epidemiology 139 (8): 803-12.
39. Lewis, Charles. 1993. "A Note on the Value of Including the Studied Item in the Test Score When Analyzing Test Items for DIF." Pp. 317-9 in Differential Item Functioning, edited by Paul W. Holland and Howard Wainer. Hillsdale, NJ: Lawrence Erlbaum.
40. Magaziner, Jay, Susan S. Bassett, and J. Richard Hebel. 1987. "Predicting Performance on the Mini-Mental State Examination: Use of Age- and Education-Specific Equations." Journal of the American Geriatrics Society 35 (11): 996-1000.
41. Marshall, Sarah C., Dan Mungas, Melinda Weldon, Bruce Reed, and Mary Haan. 1997. "Differential Item Functioning in the Mini-Mental State Examination in English- and Spanish-Speaking Older Adults." Psychology and Aging 12 (4): 718-25.
42. Mayfield, Demmie, Gail McLeod, and Patricia Hall. 1974. "The CAGE Questionnaire: Validation of a New Alcoholism Screening Instrument." American Journal of Psychiatry 131 (10): 1121-3.
43. McAllister, Patricia H. 1993. "Testing, DIF, and Public Policy." Pp. 3-23 in Differential Item Functioning, edited by Paul W. Holland and Howard Wainer. Hillsdale, NJ: Lawrence Erlbaum.
44. McDonald, Clement J., William M. Tierney, J. Marc Overhage, D. K. Martin, and G. A. Wilson. 1992. "The Regenstrief Medical Record System: 20 Years of Experience in Hospitals, Clinics, and Neighborhood Health Centers." MD Computing 9 (4): 206-17.
45. McVey, Laura J., Peter M. Becker, Constance C. Saltz, John R. Feussner, and Harvey J. Cohen. 1989. "Effect of a Geriatric Consultation Team on Functional Status of Elderly Hospitalized Patients." Annals of Internal Medicine 110 (1): 79-84.
46. Mediamark Research. 1996. Multimedia Audiences. New York: Mediamark Research.
47. Meredith, William, and Roger E. Millsap. 1992. "On the Misuse of Manifest Variables in the Detection of Measurement Bias." Psychometrika 57 (2): 289-311.
48. Millsap, Roger E., and William Meredith. 1992. "Inferential Conditions in the Statistical Detection of Measurement Bias." Applied Psychological Measurement 16 (4): 389-402.
49. Monahan, Patrick. 2000. "The Effect of Unequal Variances in the Ability Distributions on the Type I Error Rate of the Mantel-Haenszel Chi-Square Test for Detecting DIF." Presented at the annual meeting of the National Council on Measurement in Edication, April 25-27, New Orleans.
50. Monahan, Patrick, and Robert D. Ankemann. 2005. "Effect of Unequal Variances in Proficiency Distributions on Type I Error Rate of the Mantel-Haenszel Chi-Square Test for Differential Item Functioning." Journal of Educational Measurement, 42(2).
51. Narayanan, Pankaja, and H. Swaminathan. 1994. "Performance of the Mantel-Haenszel and Simultaneous Item Bias Procedures for Detecting Differential Item Functioning." Applied Psychological Measurement 18 (4): 315-28.
52. National Telecommunications and Information Administration. 2003. Percent of U.S. Households with a Telephone by Race/Origin. Retrieved October 22, 2003, from http://www.ntia.doc.gov/ntiahome/fttn99/App_III/Chart-A-3.html
53. Ortiz, Irene E., Asenath LaRue, Linda J. Romero, M. Frances Sassaman, and Robert D. Lindeman. 1997. "Comparison of Cultural Bias in Two Cognitive Screening Instruments in Elderly Hispanic Patients in New Mexico." American Journal of Geriatric Psychiatry 5 (4): 333-8.
54. Overhage, J. Marc, Clement J. McDonald, and Jeffrey G. Suico. 2000. "The Regenstrief Medical Record System 2000: Expanding the Breadth and Depth of a Community Wide EMR." Proceedings of the American Medical Informatics Association Symposia p. 1173.
55. Petersen, Morten A., Mogens Groenvold, Jakob B. Bjorner, Neil Aaronson, Thierry Conroy, Ann Cull, Peter Fayers, Marianne Hjermstad, Mirjam Sprangers, and Marianne Sullivan. 2003. "Use of Differential Item Functioning Analysis to Assess the Equivalence of Translations of a Questionnaire." Quality of Life Research 12:373-85.
56. Pfeiffer, Eric. 1975. "A Short Portable Mental Status Questionnaire for the Assessment of Organic Brain Deficit in Elderly Patients." Journal of the American Geriatrics Society 23 (10): 433-41.
57. Radloff, Lenore S. 1977. "The CES-D Scale: A Self-Report Depression Scale for Research in the General Population." Applied Psychological Measurement 1 (3): 385-401.
58. Raju, Nambury S., and Barbara B. Ellis. 2002. "Differential Item and Test Functioning." Pp. 157-88 in Measuring and Analyzing Behavior in Organizations: Advances in Measurement and Data Analysis, edited by F. Drasgow and N. Schmitt. San Francisco: Jossey-Bass.
59. Ree, M. J. 1993. "Foreword: Differential Item Functioning (DIF): A Perspective From the Air Force Human Resources Laboratory." Pp. xi-xii in Differential Item Functioning, edited by P. Holland and Wainer H. Hillsdale. Hillsdale, NJ: Lawrence Erlbaum.
60. Roussos, Louis A., and William F. Stout. 1996. "Simulation Studies Item Parameters on SIBTEST and Mantel-Haenszel Type I Error Performance." Journal of Educational Measurement 33 (2): 215-30.
61. Salive, Marcel E., Karen S. Collins, Daniel J. Foley, and Linda K. George. 1993. "Predictors of Nursing Home Admission in a Biracial Population." American Journal of Public Health 83 (12): 1765-7.
62. SAS Institute. 1989. SAS/STAT User's Guide, Version 6, Fourth Edition, Volume 2. Cary, NC: SAS Institute.
63. Shealy, Robin, and William F. Stout. 1993. "A Model-Based Standardization Approach That Separates True Bias/DIF From Group Differences and Detects Test Bias/DTF as Well as Item Bias/DIF." Psychometrica 58:159-94.
64. Smith, Larissa L., and Steven P. Reise. 1998. "Gender Differences on Negative Affectivity: An IRT Study of Differential Item Functioning on the Multidimensional Personality Questionnaire Stress Reaction Scale." Journal of Personality and Social Psychology 75 (5): 1350-62.
65. Stewart, Anita L., and Anna Napoles-Springer. 2000. "Health-Related Quality-of-Life Assessments in Diverse Population Groups in the United States." Medical Care 38 (9 Suppl): II-102-24.
66. Stout, William F., and Louis A. Roussos. 1996. Dimensionally-Based DIF/DBF Package: SIBTEST, POLY-SIBTEST, Crossing SIBTEST, DIFSIM, DIFCOMP. Urbana-Champaign, IL: William Stout Institute for Measurement.
67. Swaminathan, H., and H. Jane Rogers. 1990. "Detecting Differential Item Functioning Using Logistic Regression Procedures." Journal of Educational Measurement 27 (4): 361-70.
68. Teresi, Jeanne A., Peter S. Cross, and Robert R. Golden. 1989. "Some Applications of Latent Trait Analysis to the Measurement of ADL." Journal of Gerontology 44 (5): S196-204.
69. Teresi, Jeanne A., Robert R. Golden, Peter S. Cross, Barry Gurland, Marjorie Kleinman, and D. Wilder. 1995. "Item Bias in Cognitive Screening Measures: Comparisons of Elderly White, Afro-American, Hispanic and High and Low Education Subgroups." Journal of Clinical Epidemiology 48 (4): 473-83.
70. Teresi, Jeanne A., Marjorie Kleinman, and Katja Ocepek. 2000. "Modern Psychometric Methods for Detection of Differential Item Functioning: Application to Cognitive Assessment Measures." Statistics in Medicine 19:1651-83.
71. Teresi, Jeanne A., Marjorie Kleinman, Katja Ocepek-Welikson, Mildred Ramirez, Barry Gurland, Rafael Lantigua, and Douglas Holmes. 2000. "Applications of Item Response Theory to the Examination of the Psychometric Properties and Differential Item Functioning of the Comprehensive Assessment and Referral Evaluation Dementia Diagnostic Scale Among Samples of Latino, African American, and White Non-Latino Elderly." Research on Aging 22 (6): 738-73.
72. Thissen, David. 1991. MULTILOG User's Guide: Multiple, Categorical Item Analysis and Test Scoring Using Item Response Theory [Computer software]. Chicago: Scientific Software International.
73. Thissen, David, Lynne Steinberg, and Howard Wainer. 1993. "Detection of Differential Item Functioning Using the Parameters of Item Response Models." Pp. 67-111 in Differential Item Functioning, edited by Paul W. Holland and Howard Wainer. Hillsdale, NJ: Lawrence Erlbaum.
74. Tierney, William M., M. E. Miller, Siu L. Hui, and Clement J. McDonald. 1991. "Practice Randomization and Clinical Research. The Indiana Experience." Medical Care 29 (7 Suppl): JS57-64.
75. U.S. Census Bureau. 2000. Historical Poverty Tables: Poverty by Definition of Income (R&D). Retrieved August 2001 from http://www.census. gov.hhes/poverty/histpov/rdp03.html
76. U.S. Department of Health and Human Services. 2002. Healthy People 2010. Retrieved April 23, 2002, from http:/www.health.gov/healthypeople/document/html/ uih/uih_2.htm
77. U.S. Department of Health and Human Services. 2003. Dynamic Assessment of Patient-Reported Chronic Disease Outcomes, RFA-RM-04-011. Retrieved November 19, 2003, from http://grants.nih.gov/grants/guide/rfa-files/RFA-RM-04-011.html
78. Uttaro, Thomas, and Roger E. Millsap. 1994. "Factors Influencing the Mantel-Haenszel Procedure in the Detection of Differential Item Functioning." Applied Psychological Measurement 18 (1): 15-25.
79. Wainer, Howard, and Robert Lukhele. 1997. "Managing the Influence of DIF From Big Items: The 1988 Advanced Placement History Test as an Example." Applied Measurement in Education 10 (3): 201-15.
80. Woodard, John L., Alexander P. Auchus, Robert E. Godsall, and Robert C. Green. 1998. "An Analysis of Test Bias and Differential Item Functioning Due to Race on the Mattis Dementia Rating Scale." Journal of Gerontology 53B (6): P370-4.
81. Zwick, Rebecca. 1990. "When Do Item Response Function and Mantel-Haenszel Definitions of Differential Item Functioning Coincide?" Journal of Educational Statistics 15 (3): 185-97.
82. Zwick, Rebecca, Dorothy T. Thayer, and John Mazzeo. 1997. "Descriptive Inferential Procedures for Assessing Differential Item Functioning in Polytomous Items." Applied Measurement in Education 10 (4): 321-44.
83. Zwick, Rebecca, Dorothy T. Thayer, and Marilyn Wingersky. 1994. "A Simulation Study of Methods for Assessing Differential Item Functioning in Computerized Adaptive Tests." Applied Psychological Measurement 18 (2): 121-40.