Validation of the computerized adaptive test for mental health in primary care

Annals of Family Medicine

Volumn 17, Issue 1, 2019, Pages 23-30

  Graham, Andrea K ^a   Minc, Alexa ^b   Staab, Erin ^b   Beiser, David G ^b   Gibbons, Robert D ^b   Laiteerapong, Neda ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

Author keywords

Anxiety; Depression; Electronic health records; Health informatics; Mental health; Practice based research; Primary care; Screening; Surveys and questionnaires; Symptom assessment; Vulnerable populations

Indexed keywords

COMPUTER ASSISTED DIAGNOSIS; FEMALE; HUMAN; MAJOR DEPRESSION; MALE; MASS SCREENING; MIDDLE AGED; PRIMARY HEALTH CARE; PROCEDURES; PSYCHOLOGICAL RATING SCALE; QUESTIONNAIRE; REPRODUCIBILITY;

DEPRESSIVE DISORDER, MAJOR; DIAGNOSIS, COMPUTER-ASSISTED; FEMALE; HUMANS; MALE; MASS SCREENING; MIDDLE AGED; PRIMARY HEALTH CARE; PSYCHIATRIC STATUS RATING SCALES; REPRODUCIBILITY OF RESULTS; SURVEYS AND QUESTIONNAIRES;

EID: 85060387250     PISSN: 15441709     EISSN: 15441717     Source Type: Journal    
DOI: 10.1370/afm.2316     Document Type: Article

References (62)

1. Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):617-627.
2. Wang PS, Lane M, Olfson M, Pincus HA, Wells KB, Kessler RC. Twelve-month use of mental health services in the United States: results from the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):629-640.
3. Wang PS, Demler O, Olfson M, Pincus HA, Wells KB, Kessler RC. Changing profiles of service sectors used for mental health care in the United States. Am J Psychiatry. 2006;163(7):1187-1198.
4. Cepoiu M, McCusker J, Cole MG, Sewitch M, Belzile E, Ciampi A. Recognition of depression by non-psychiatric physicians—a systematic literature review and meta-analysis. J Gen Intern Med. 2008; 23(1):25-36.
5. Mitchell AJ, Vaze A, Rao S. Clinical diagnosis of depression in primary care:a meta-analysis. Lancet. 2009;374(9690):609-619.
6. Cunningham PJ. Beyond parity:primary care physicians’ perspectives on access to mental health care. Health Aff (Millwood). 2009; 28(3):w490-w501.
7. Trude S, Stoddard JJ. Referral gridlock:primary care physicians and mental health services. J Gen Intern Med. 2003;18(6):442-449.
8. Loeppke R, Taitel M, Haufle V, Parry T, Kessler RC, Jinnett K. Health and productivity as a business strategy:a multiemployer study. J Occup Environ Med. 2009;51(4):411-428.
9. Herrman H, Patrick DL, Diehr P, et al. Longitudinal investigation of depression outcomes in primary care in six countries:the LIDO study. Functional status, health service use and treatment of people with depressive symptoms. Psychol Med. 2002;32(5):889-902.
10. Whooley MA, Simon GE. Managing depression in medical outpatients. N Engl J Med. 2000;343(26):1942-1950.
11. Rost K, Zhang M, Fortney J, Smith J, Coyne J, Smith GR Jr. Persistently poor outcomes of undetected major depression in primary care. Gen Hosp Psychiatry. 1998;20(1):12-20.
12. Merikangas KR, Ames M, Cui L, et al. The impact of comorbidity of mental and physical conditions on role disability in the US adult household population. Arch Gen Psychiatry. 2007;64(10):1180-1188.
13. Simon G, Ormel J, VonKorff M, Barlow W. Health care costs associated with depressive and anxiety disorders in primary care. Am J Psychiatry. 1995;152(3):352-357.
14. Siu AL, Bibbins-Domingo K, Grossman DC, et al;US Preventive Services Task Force (USPSTF). Screening for depression in adults:US Preventive Services Task Force recommendation statement. JAMA. 2016;315(4):380-387.
15. Whooley MA. Screening for depression—a tale of two questions. JAMA Intern Med. 2016;176(4):436-438.
16. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder:the GAD-7. Arch Intern Med. 2006;166(10):1092-1097.
17. Kroenke K, Spitzer RL, Williams JB. The Patient Health Questionnaire-2:validity of a two-item depression screener. Med Care. 2003;41(11):1284-1292.
18. Kroenke K, Spitzer RL, Williams JB. The PHQ-9:validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606-613.
19. Office of the National Coordinator for Health Information Technology. Office-based physician electronic health record adoption, health IT quick-stat #50. https://dashboard.healthit.gov/quickstats/pages/physician-ehr-adoption-trends.php. Published Dec 2016. Accessed May 9, 2017.
20. Gershon RC, Rothrock N, Hanrahan R, Bass M, Cella D. The use of PROMIS and assessment center to deliver patient-reported outcome measures in clinical research. J Appl Meas. 2010;11(3):304-314.
21. Cella D, Riley W, Stone A, et al.; PROMIS Cooperative Group. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks:2005-2008. J Clin Epidemiol. 2010; 63(11):1179-1194.
22. Pilkonis PA, Yu L, Dodds NE, Johnston KL, Maihoefer CC, Lawrence SM. Validation of the depression item bank from the Patient-Reported Outcomes Measurement Information System (PROMIS) in a three-month observational study. J Psychiatr Res. 2014;56:112-119.
23. Wagner LI, Schink J, Bass M, et al. Bringing PROMIS to practice: brief and precise symptom screening in ambulatory cancer care. Cancer. 2015;121(6):927-934.
24. Riley WT, Pilkonis P, Cella D. Application of the National Institutes of Health Patient-reported Outcome Measurement Information System (PROMIS) to mental health research. J Ment Health Policy Econ. 2011;14(4):201-208.
25. Jensen RE, Rothrock NE, DeWitt EM, et al. The role of technical advances in the adoption and integration of patient-reported outcomes in clinical care. Med Care. 2015;53(2):153-159.
26. Vilagut G, Forero CG, Adroher ND, Olariu E, Cella D, Alonso J; INSAyD investigators. Testing the PROMIS Depression measures for monitoring depression in a clinical sample outside the US. J Psychiatr Res. 2015;68:140-150.
27. Gibbons RD, Weiss DJ, Frank E, Kupfer D. Computerized adaptive diagnosis and testing of mental health disorders. Annu Rev Clin Psychol. 2016;12:83-104.
28. Sunderland M, Batterham P, Carragher N, Calear A, Slade T. Developing and validating a computerized adaptive test to measure broad and specific factors of internalizing in a community sample. Assessment. https://doi.org/10.1177/1073191117707817.
29. Smits N, Cuijpers P, van Straten A. Applying computerized adaptive testing to the CES-D scale:a simulation study. Psychiatry Res. 2011; 188(1):147-155.
30. Magnee T, de Beurs DP, Terluin B, Verhaak PF. Applying computerized adaptive testing to the Four-Dimensional Symptom Questionnaire (4DSQ):a simulation study. JMIR Ment Health. 2017;4(1):e7.
31. Fliege H, Becker J, Walter OB, Rose M, Bjorner JB, Klapp BF. Evaluation of a computer-adaptive test for the assessment of depression (D-CAT) in clinical application. Int J Methods Psychiatr Res. 2009; 18(1):23-36.
32. Flens G, Smits N, Carlier I, van Hemert AM, de Beurs E. Simulating computer adaptive testing with the Mood and Anxiety Symptom Questionnaire. Psychol Assess. 2016;28(8):953-962.
33. Devine J, Fliege H, Kocalevent R, Mierke A, Klapp BF, Rose M. Evaluation of computerized adaptive tests (CATs) for longitudinal monitoring of depression, anxiety, and stress reactions. J Affect Disord. 2016;190:846-853.
34. Becker J, Fliege H, Kocalevent RD, et al. Functioning and validity of a computerized adaptive test to measure anxiety (A-CAT). Depress Anxiety. 2008;25(12):E182-E194.
35. Loe BS, Stillwell D, Gibbons C. Computerized Adaptive Testing provides reliable and efficient depression measurement using the CES-D scale. J Med Internet Res. 2017;19(9):e302.
36. Walter OB, Becker J, Bjorner JB, Fliege H, Klapp BF, Rose M. Development and evaluation of a computer adaptive test for ‘Anxiety’ (Anxiety-CAT). Qual Life Res. 2007;16(Suppl 1):143-155.
37. Stochl J, Böhnke JR, Pickett KE, Croudace TJ. An evaluation of computerized adaptive testing for general psychological distress: combining GHQ-12 and Affectometer-2 in an item bank for public mental health research. BMC Med Res Methodol. 2016;16:58.
38. Gibbons RD, Hooker G, Finkelman MD, et al. The computerized adaptive diagnostic test for major depressive disorder (CAD-MDD): a screening tool for depression. J Clin Psychiatry. 2013;74(7): 669-674.
39. Gibbons RD, Weiss DJ, Pilkonis PA, et al. Development of a computerized adaptive test for depression. Arch Gen Psychiatry. 2012;69(11): 1104-1112.
40. Beiser D, Vu M, Gibbons R. Test-retest reliability of a computerized adaptive depression screener. Psychiatr Serv. 2016;67(9):1039-1041.
41. Gibbons RD, Weiss DJ, Pilkonis PA, et al. Development of the CAT-ANX:a computerized adaptive test for anxiety. Am J Psychiatry. 2014;171(2):187-194.
42. Achtyes ED, Halstead S, Smart L, et al. Validation of computerized adaptive testing in an outpatient nonacademic setting:the VOCA-TIONS trial. Psychiatr Serv. 2015;66(10):1091-1096.
43. Borson S, Scanlan J, Brush M, Vitaliano P, Dokmak A. The mini-cog: a cognitive ‘vital signs’ measure for dementia screening in multilingual elderly. Int J Geriatr Psychiatry. 2000;15(11):1021-1027.
44. Borson S, Scanlan JM, Watanabe J, Tu SP, Lessig M. Improving identification of cognitive impairment in primary care. Int J Geriatr Psychiatry. 2006;21(4):349-355.
45. First MB, Williams JBW, Karg RS, Spitzer RL. Structured clinical interview for DSM-5–Research Version (SCID-5 for DSM-5, Research Version; SCID-5-RV). Arlington, VA:American Psychiatric Association;2015.
46. Stuart AL, Pasco JA, Jacka FN, Brennan SL, Berk M, Williams LJ. Comparison of self-report and structured clinical interview in the identification of depression. Compr Psychiatry. 2014;55(4):866-869.
47. Kroenke K, Spitzer RL, Williams JB, Löwe B. The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales:a systematic review. Gen Hosp Psychiatry. 2010;32(4):345-359.
48. Huang FY, Chung H, Kroenke K, Delucchi KL, Spitzer RL. Using the Patient Health Questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. J Gen Intern Med. 2006;21(6):547-552.
49. Mitchell AJ, Yadegarfar M, Gill J, Stubbs B. Case finding and screening clinical utility of the Patient Health Questionnaire (PHQ-9 and PHQ-2) for depression in primary care:a diagnostic meta-analysis of 40 studies. BJPsych Open. 2016;2(2):127-138.
50. Hajian-Tilaki K. Sample size estimation in diagnostic test studies of biomedical informatics. J Biomed Inform. 2014;48:193-204.
51. McFall RM, Treat TA. Quantifying the information value of clinical assessments with signal detection theory. Annu Rev Psychol. 1999;50:215-241.
52. Viera AJ, Garrett JM. Understanding interobserver agreement:the kappa statistic. Fam Med. 2005;37(5):360-363.
53. Khanna D, Maranian P, Rothrock N, et al. Feasibility and construct validity of PROMIS and “legacy” instruments in an academic sclero-derma clinic. Value Health. 2012;15(1):128-134.
54. Hinami K, Smith J, Deamant CD, Kee R, Garcia D, Trick WE. Health perceptions and symptom burden in primary care:measuring health using audio computer-assisted self-interviews. Qual Life Res. 2015;24(7):1575-1583.
55. Bruckel J, Wagle N, O’Brien C, et al. Feasibility of a tablet computer system to collect patient-reported symptom severity in patients undergoing diagnostic coronary angiography. Crit Pathw Cardiol. 2015;14(4):139-145.
56. Schalet BD, Pilkonis PA, Yu L, et al. Clinical validity of PROMIS Depression, Anxiety, and Anger across diverse clinical samples. J Clin Epidemiol. 2016;73:119-127.
57. Gibbons RD, Kupfer D, Frank E, Moore T, Beiser DG, Boudreaux ED. Development of a computerized adaptive test suicide scale-The CAT-SS. J Clin Psychiatry. 2017;78(9):1376-1382.
58. Marcano-Belisario JS, Gupta AK, O’Donoghue J, Ramchandani P, Morrison C, Car J. Implementation of depression screening in antenatal clinics through tablet computers:results of a feasibility study. BMC Med Inform Decis Mak. 2017;17(1):59.
59. Gidding LG, Spigt M, Winkens B, Herijgers O, Dinant GJ. PsyScan e-tool to support diagnosis and management of psychological problems in general practice:a randomised controlled trial. Br J Gen Pract. 2018;68(666):e18-e27.
60. Kroenke K, Talib TL, Stump TE, et al. Incorporating PROMIS symptom measures into primary care practice-a randomized clinical trial. J Gen Intern Med. 2018;33(8):1245-1252.
61. Bryan S, Davis J, Broesch J, et al. Choosing your partner for the PROM:a review of evidence on patient-reported outcome measures for use in primary and community care. Healthc Policy. 2014;10(2): 38-51.
62. Gardner W, Kelleher KJ, Pajer KA. Multidimensional adaptive testing for mental health problems in primary care. Med Care. 2002; 40(9):812-823.