Development of a parent-report cognitive function item bank using item response theory and exploration of its clinical utility in computerized adaptive testing

Journal of Pediatric Psychology

Volumn 36, Issue 7, 2011, Pages 766-779

  Lai, Jin Shei ^a   Butt, Zeeshan ^a,b   Zelko, Frank ^c   Cella, David ^a   Krull, Kevin R ^d   Kieran, Mark W ^d   Goldman, Stewart ^c  

^a NORTHWESTERN UNIVERSITY   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

^c CHILDREN'S MEMORIAL HOSPITAL   (United States)

^d BOSTON CHILDREN S HOSPITAL   (United States)

Author keywords

assessment; cancer and oncology; cognitive assessment; computer applications eHealth; neuropsychology; quality of life

Indexed keywords

ADOLESCENT; ARTICLE; CHILD; COGNITION; COGNITIVE DEFECT; DAILY LIFE ACTIVITY; FEMALE; HUMAN; MALE; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; PSYCHOMETRY; REPRODUCIBILITY; VALIDATION STUDY;

ACTIVITIES OF DAILY LIVING; ADOLESCENT; CHILD; COGNITION; COGNITION DISORDERS; FEMALE; HUMANS; MALE; NEUROPSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 80051706200     PISSN: 01468693     EISSN: 1465735X     Source Type: Journal    
DOI: 10.1093/jpepsy/jsr005     Document Type: Article

References (44)

1. Achenbach, T. M. (1991). Integrative guide to the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington, VT: University of Vermont, Department of Psychology.
2. Achenbach, T. M., & Edelbrock, C. (1983). Manual for the Child Behavior Checklist and Revised Child Behavior Profile. Burlington, VT: University of Vermont, Department of Psychiatry.
3. Bjorner, J. B., Chang, C. H., Thissen, D., & Reeve, B. B. (2007). Developing tailored instruments: Item banking and computerized adaptive assessment. Quality of Life Research, 16, 95-108. (Pubitemid 47036912)
4. Cardarelli, C., Cereda, C., Masiero, L., Viscardi, E., Faggin, R., Laverda, A., Perilongo, G. (2006). Evaluation of health status and health-related quality of life in a cohort of Italian children following treatment for a primary brain tumor. Pediatric Blood and Cancer, 46(5), 637-644.
5. Cella, D., Gershon, R., Lai, J. S., & Choi, S. (2007). The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research, 16(Suppl 1), 133-141. (Pubitemid 47036925)
6. Choi, S. (2009). Firestar: Computerized Adaptive Testing Simulation Program for Polytomous Item Response Theory Models. Applied Psychological Measurement, 33(8), 644-645.
7. Choi, S. W., Gibbons, L. E., & Crane, P. K. (2008). Development of Freeware for an Iterative Hybrid Ordinal Logistic Regression/Item Response Theory Differential Item Functioning Framework, and an Illustration of Analyses of DIF Related to Age, Gender, and Education on the PROMIS Anxiety Scale. Paper presented at the Second PROMIS Conference: Improving Measurement of Patient-Reported Outcomes-New Tools and the Science Behind Them, Bethesda, MD.
8. Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., & Cella, D. (2009). Efficiency of static and computer adaptive short forms compared to full length measures of depressive symptoms. Quality of Life Research, 19(1), 125-136.
9. Crane, P. K., Gibbons, L. E., Jolley, L., & van Belle, G. (2006). Differential Item Functioning Analysis With Ordinal Logistic Regression Techniques: DIFdetect and difwithpar. Medical Care, 44(11 Suppl 3), S115-S123. (Pubitemid 44632037)
10. De Groot, J. C., de Leeuw, F. E., Oudkerk, M., Hofman, A., Jolles, J., & Breteler, M. M. (2001). Cerebral white matter lesions and subjective cognitive dysfunction: The Rotterdam Scan Study. Neurology, 56(11), 1539-1545. (Pubitemid 32532267)
11. DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A.PROMIS Cooperative Group (2007). Evaluation of Item Candidates: The PROMIS Qualitative Item Review. Medical Care, 45(5 Suppl 1), S12-S21.
12. Ferguson, R. J., McDonald, B. C., Saykin, A. J., & Ahles, T. A. (2007). Brain structure and function differences in monozygotic twins: Possible effects of breast cancer chemotherapy. Journal of Clinical Oncology, 25(25), 3866-3870. (Pubitemid 47477262)
13. Gioia, G. A., Isquith, P., Guy, S., & Kenworthy, L. (2000). Behavior rating inventory of executive function (BRIEF): Professional Manual. Odessa, FL: Psychological Assessment Resources.
14. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory. Newbury Park, CA: SAGE Publications, Inc.
15. Iuvone, L., Mariotti, P., Colosimo, C., Guzzetta, F., Ruggiero, A., & Riccardi, R. (2002). Long-term cognitive outcome, brain computed tomography scan, and magnetic resonance imaging in children cured for acute lymphoblastic leukemia. Cancer, 95(12), 2562-2570. (Pubitemid 35424043)
16. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12-19.
17. Krull, K. R., Okcu, M. F., Potter, B., Jain, N., Dreyer, Z., Kamdar, K., & Brouwers, P. (2008). Screening for Neurocognitive Impairment in Pediatric Cancer Long-Term Survivors. Journal of Clinical Oncology, 26(25), 4138-4143.
18. Lai, J. S., Cella, D., Choi, S. W., Junghaenel, D. U., Christodolou, C., & Gershon, R. (in press). Development of the PROMIS Fatigue Item Bank, computerized adaptive testing and short-forms. Archives of Physical Medicine and Rehabilitation.
19. Lai, J. S., Cella, D., Kupst, M. J., Holm, S., Kelly, M. E., Bode, R. K., & Goldman, S. (2007). Measuring fatigue for children with cancer: Development and validation of the pediatric Functional Assessment of Chronic Illness Therapy-Fatigue (pedsFACIT-F). Journal of Pediatric Hematology/Oncology, 29(7), 471-479. (Pubitemid 47026249)
20. Lai, J. S., Cella, D., Peterman, A., Barocas, J., & Goldman, S. (2005). Anorexia/cachexia related quality of life for children with cancer: Testing the psychometric properties of the Pediatric Functional Assessment of Anorexia/Cachexia Therapy (peds-FAACT). Cancer, 104(7), 1531-1539. (Pubitemid 41356169)
21. Lai, J. S., Goldman, S., Cella, D., & Carlson, A. (2003). Quality of Life for childhood brain tumor survivors. Quality of Life Research, 12, 792.
22. Lai, J. S., Teresi, J. A., & Gershon, R. (2005). Procedures for the analysis of Differential Item Functioning (DIF) for small sample sizes. Evaluation and the Health Professions, 28, 283-294. (Pubitemid 41129629)
23. Lai, J. S., Zelko, F., Butt, Z., Cella, D., Kieran, M., & Krull, K. (2011). Perceived cognitive function reported by parents of the United States pediatric population. Child's Nervous System, 27(2), 285-293.
24. Mahone, E. M., Martin, R., Kates, W. R., Hay, T., & Horska, A. (2009). Neuroimaging correlates of parent ratings of working memory in typically developing children. Journal of the International Neuropsychological Society, 15(1), 31-41.
25. Mantel, N. (1963). Chi-square tests with one degree of freedom: Extensions of the Mantel-Haenszel procedure. Journal of the American Statistical Association, 58, 690-700.
26. Mollica, C. M., Maruff, P., Collie, A., & Vance, A. (2005). Repeated assessment of cognition in children and the measurement of performance change. Child Neuropsychol, 11(3), 303-310. (Pubitemid 40911113)
27. Mulhern, R. K., Palmer, S. L., Reddick, W. E., Glass, J. O., Kun, L. E., Taylor, J., Gajjar, A. (2001). Risks of young age for selected neurocognitive deficits in medulloblastoma are associated with white matter loss. Journal of Clinical Oncology, 19(2), 472-479. (Pubitemid 32112861)
28. National Cancer Policy Board, Hewitt, M., Weiner, S. L., & Simone, J. V. (2003). Childhood cancer survivorship: Improving care and quality of life. Washington, DC: National Academies Press.
29. Orlando, M., & Thissen, D. (2003). Further examination of the performance of S-X 2, an item fit index for di-chotomous item response theory models. Applied Psychological Measurement, 27, 289-298. (Pubitemid 36891669)
30. Packer, R. J., Gurney, J. G., Punyko, J. A., Donaldson, S. S., Inskip, P. D., Stovall, M., Robison, L. L. (2003). Long-term neurologic and neurosensory sequelae in adult survivors of a childhood brain tumor: Childhood cancer survivor study. Journal of Clinical Oncology, 21(17), 3255-3261. (Pubitemid 46606258)
31. Penfield, R. D. (2006). DIFAS: Differential Item Functioning Analysis System. Applied Psychological Measurement, 29, 150-151.
32. Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27-48.
33. Ris, M. D., Packer, R., Goldwein, J., Jones-Wallace, D., & Boyett, J. M. (2001). Intellectual outcome after reduced-dose radiation therapy plus adjuvant chemotherapy for medulloblastoma: A Children's Cancer Group study. Journal of Clinical Oncology, 19(15), 3470-3476. (Pubitemid 32730083)
34. Samejima, F., van der Liden, W. J., & Hambleton, R. (1996). The graded response model. In W. J. van der Linden (Ed.), Handbook of modern item response theory (pp. 85-100). New York, New York: Springer.
35. Schatz, J., Kramer, J. H., Ablin, A., & Matthay, K. K. (2000). Processing speed, working memory, and IQ: A developmental model of cognitive deficits following cranial radiation therapy. Neuropsychology, 14(2), 189-200.
36. Sonderkaer, S., Schmiegelow, M., Carstensen, H., Nielsen, L. B., Muller, J., & Schmiegelow, K. (2003). Long-term neurological outcome of childhood brain tumors treated by surgery only. Journal of Clinical Oncology, 21(7), 1347-1351. (Pubitemid 46606414)
37. Sparrow, S. S., Balla, D. A., Cicchetti, D. V., & Doll, E. A. (2005). Vineland-II, Vineland adaptive behavior scales: Survey forms manual. Minneapolis, MN; Circle Pines, Minn.: NCS Pearson, Inc.; AGS Publishing.
38. Temkin, N. R., Heaton, R. K., Grant, I., & Dikmen, S. S. (1999). Detecting significant change in neuropsycho-logical test performance: A comparison of four models. Journal of the International Neuropsychological Society, 5(4), 357-369. (Pubitemid 29292202)
39. Thissen, D. (2003). MULTILOG (Version Windows 7.0). Lincolnwood, IL: Scientific Software International, Inc.
40. Thissen, D., Orlando, M., Thissen, D., & Wainer, H. (2001). Item response Theory for items scored in two categories. In D. Thissen (Ed.), Test scoring (pp. 74-140). Mahwah, NJ: Lawrence Erlbaum Associates.
41. Weiss, D. J., & Kingsbury, G. (1984). Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21(4), 361-375.
42. Wouters, H., de Koning, I., Zwinderman, A. H., van Gool, W. A., Schmand, B., Buiter, M., & Lindeboom, R. (2009). Adaptive cognitive testing in cerebrovascular disease and vascular dementia. Dementia and Geriatric Cognitive Disorders, 28(5), 486-492.
43. Zeltzer, L. K., Chen, E., Weiss, R., Guo, M. D., Robison, L. L., Meadows, A. T., Byrne, J. (1997). Comparison of psychologic outcome in adult survivors of childhood acute lymphoblastic leukemia versus sibling controls: A cooperative Children's Cancer Group and National Institutes of Health study. Journal of Clinical Oncology, 15(2), 547-556. (Pubitemid 27074221)
44. Zwick, R., & Thayer, D. T. (1996). Evaluating the magnitude of differential item functioning in polytomous items. Journal of Educational and Behavioral Statistics, 21(3), 187-201. (Pubitemid 126415084)