Meta-analytical prognostic accuracy of the Comprehensive Assessment of at Risk Mental States (CAARMS): The need for refined prediction

European Psychiatry

Volumn 49, Issue , 2018, Pages 62-68

  Oliver, D ^a   Kotlicka Antczak, M ^b   Minichino, A ^c   Spada, G ^a   McGuire, P ^a,d,e   Fusar Poli, P ^a,d,e  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b MEDICAL UNIVERSITY OF LODZ   (Poland)

^c SAPIENZA UNIVERSITY OF ROME   (Italy)

^d SOUTH LONDON AND MAUDSLEY NHS FOUNDATION TRUST   (United Kingdom)

^e King s College London   (United Kingdom)

Author keywords

CAARMS; Clinical utility; Prevention; Prognostic accuracy; Psychosis

Indexed keywords

ACCURACY; COMPREHENSIVE ASSESSMENT OF AT RISK MENTAL STATES; HUMAN; META ANALYSIS; PREDICTION; PRIORITY JOURNAL; PROGNOSTIC ASSESSMENT; PSYCHOMETRY; PSYCHOSIS; RISK ASSESSMENT; SCORING SYSTEM; SENSITIVITY AND SPECIFICITY; SHORT SURVEY; FEMALE; MALE; PROBABILITY; PROCEDURES; PROGNOSIS; PSYCHOLOGICAL INTERVIEW; REPRODUCIBILITY; STANDARDS;

FEMALE; HUMANS; INTERVIEW, PSYCHOLOGICAL; MALE; PROBABILITY; PROGNOSIS; PSYCHOMETRICS; PSYCHOTIC DISORDERS; REPRODUCIBILITY OF RESULTS; RISK ASSESSMENT; SENSITIVITY AND SPECIFICITY;

EID: 85041408126     PISSN: 09249338     EISSN: 17783585     Source Type: Journal    
DOI: 10.1016/j.eurpsy.2017.10.001     Document Type: Short Survey

References (55)

1. Insel, T.R., Rethinking schizophrenia. Nature 468:7321 (2010), 187–193.
2. Fusar-Poli, P., McGorry, P., Kane, J., Improving outcomes of first episode psychosis. World Psychiatry 16:3 (2017), 251–265.
3. Millan, M.J., Andrieux, A., Bartzokis, G., Cadenhead, K., Dazzan, P., Fusar-Poli, P., et al. Altering the course of schizophrenia: progress and perspectives. Nat Rev Drug Discov 15:7 (2016), 485–515.
4. McGorry, P.D., Early clinical phenotypes, clinical staging, and strategic biomarker research: building blocks for personalized psychiatry. Biol Psychiatry 74:6 (2013), 394–395.
5. Fusar-Poli, P., Extending the benefits of indicated prevention to improve outcomes of first episode psychosis. JAMA Psychiatry 74:7 (2017), 667–668.
6. Fusar-Poli, P., Schultze-Lutter, F., Predicting the onset of psychosis in patients at clinical high risk: practical guide to probabilistic prognostic reasoning. Evid Based Ment Health 19:1 (2016), 10–15.
7. Arbyn, M., Verdoodt, F., Snijders, P.J.F., Verhoef, V.M.J., Suonio, E., Dillner, L., et al. Accuracy of human papillomavirus testing on self-collected versus clinician-collected samples: a meta-analysis. Lancet Oncol 15:2 (2014), 172–183.
8. Tabák, A.G., Herder, C., Rathmann, W., Brunner, E.J., Kivimäki, M., Prediabetes: a high-risk state for diabetes development. Lancet 379:9833 (2012), 2279–2290.
9. Hippisley-Cox, J., Coupland, C., Vinogradova, Y., Robson, J., May, M., Brindle, P., Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ, 335(7611), 2007, 136.
10. Fusar-Poli, P., Meyer-Lindenberg, A., Forty years of structural imaging in psychosis: promises and truth. Acta Psychiatr Scand 134:3 (2016), 207–224.
11. Yung, A.R., Yuen, H.P., McGorry, P.D., Phillips, L.J., Kelly, D., Dell'Olio, M., et al. Mapping the onset of psychosis: the Comprehensive Assessment of At-Risk Mental States. Aust N Z J Psychiatry 39:11–12 (2005), 964–971.
12. NHS England, Intervention in Psychosis Access and Waiting Time Standard [Internet]. 2016, NHS England Publications, UK Available from: https://www.england.nhs.uk/mentalhealth/wp-content/uploads/sites/29/2016/04/eip-guidance.pdf.
13. Yung, A.R., Stanford, C., Cosgrave, E., Killackey, E., Phillips, L., Nelson, B., et al. Testing the ultra high risk (prodromal) criteria for the prediction of psychosis in a clinical sample of young people. Schizophr Res 84:1 (2006), 57–66.
14. Fusar-Poli, P., Cappucciati, M., Rutigliano, G., Schultze-Lutter, F., Bonoldi, I., Borgwardt, S., et al. At risk or not at risk? A meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction. World Psychiatry 14:3 (2015), 322–332.
15. Miller, T.J., McGlashan, T.H., Rosen, J.L., Cadenhead, K., Cannon, T., Ventura, J., et al. Prodromal assessment with the structured interview for prodromal syndromes and the scale of prodromal symptoms: predictive validity, interrater reliability, and training to reliability. Schizophr Bull 29:4 (2003), 703–715.
16. Schultze-Lutter, F., Ruhrmann, S., Picker, H., Klosterkötter, J., WC1C development and evaluation of the Schizophrenia Proneness Instrument, Adult version (SPI-A). Schizophr Res 86 (2006), S4–S5.
17. Fusar-Poli, P., Cappucciati, M., Rutigliano, G., Lee, T.Y., Beverly, Q., Bonoldi, I., et al. Towards a standard psychometric diagnostic interview for subjects at ultra high risk of psychosis: CAARMS versus SIPS. Psychiatry J, 2016, 7146–7341.
18. Fusar-Poli, P., Rocchetti, M., Sardella, A., Avila, A., Brandizzi, M., Caverzasi, E., et al. Disorder, not just state of risk: meta-analysis of functioning and quality of life in people at high risk of psychosis. Br J Psychiatry 207:3 (2015), 198–206.
19. Kempton, M.J., Bonoldi, I., Valmaggia, L., McGuire, P., Fusar-Poli, P., Speed of psychosis progression in people at ultra-high clinical risk. JAMA Psychiatry, 72(6), 2015, 622.
20. Stroup, D.F., Berlin, J.A., Morton, S.C., Olkin, I., Williamson, G.D., Rennie, D., et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 283:15 (2000), 2008–2012.
21. Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med, 6(7), 2009, e1000097.
22. Whiting, P.F., Rutjes, A.W.S., Westwood, M.E., Mallett, S., Deeks, J.J., Reitsma, J.B., et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 155:8 (2011), 529–536.
23. Macaskill, P., Gatsonis, C., Deeks, J.J., Harbord, R.M., Takwoingi, Y., Analysing and presenting results. Deeks, J.J., Bossuyt, P.M., Gatsonis, C., (eds.) Handbook for systematic reviews of diagnostic test accuracy, 2010, The Cochrane Colloration.
24. Smetana, G.W., Umscheid, C.A., Chang, S., Matchar, D.B., Methods guide for authors of systematic reviews of medical tests: a collaboration between the Agency for Healthcare Research and Quality (AHRQ) and the Journal of General Internal Medicine. J Gen Intern Med 27:Suppl. 1 (2012), S1–S3.
25. Dwamena, B.A., MIDAS: computational and graphical routines for meta-analytical integration of diagnostic accuracy studies in Stata. 2007, Division of Nuclear Medicine, Department of Radiology, University of Michigan Medical School, Ann Arbor.
26. StataCorp., STATA. College Station. 2015, StataCorp LP, TX.
27. Harbord, R., Whiting, P., Metandi: meta-analysis of diagnostic accuracy using hierarchical logistic regression. Stata Journal [Internet] 9:2 (2009), 211–229 Available from: http://www.stata-journal.com/article.html?article=st0163 [19].
28. Janda, S., Shahidi, N., Gin, K., Swiston, J., Diagnostic accuracy of echocardiography for pulmonary hypertension: a systematic review and meta-analysis. Heart 97:8 (2011), 612–622.
29. Hosmer, D.W., Lemeshow, S., May, S., Applied survival analysis: regression modeling of time-to-event data. 2nd ed. 2008, Wiley-Interscience, Hoboken, N.J.
30. Lipsey, M.W., Wilson, D.B., Practical meta-analysis. 2000, Sage Publications, Thousand Oaks, Calif.
31. Bekkar, M., Djemaa, H., Alitouche, T., Evaluation measures for modelsassessment over imbalanced data sets. J Inf Eng Appl 3 (2013), 27–38.
32. Higgins, J.P.T., Thompson, S.G., Deeks, J.J., Altman, D.G., Measuring inconsistency in meta-analyses. BMJ 327:7414 (2003), 557–560.
33. Deeks, J.J., Macaskill, P., Irwig, L., The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 58:9 (2005), 882–893.
34. Wanders, L.K., East, J.E., Uitentuis, S.E., Leeflang, M.M.G., Dekker, E., Diagnostic performance of narrowed spectrum endoscopy, autofluorescence imaging, and confocal laser endomicroscopy for optical diagnosis of colonic polyps: a meta-analysis. Lancet Oncol 14:13 (2013), 1337–1347.
35. Li, J., Fine, J.P., Safdar, N., Prevalence-dependent diagnostic accuracy measures. Stat Med 26:17 (2007), 3258–3273.
36. Fusar-Poli, P., Rutigliano, G., Stahl, D., Davies, C., De Micheli, A., Ramella-Cravaro, V., et al. Long-term validity of the At Risk Mental State (ARMS) for predicting psychotic and non-psychotic mental disorders. Eur Psychiatry 42 (2017), 49–54.
37. Francesconi, M., Minichino, A., Carrión, R.E., Delle Chiaie, R., Bevilacqua, A., Parisi, M., et al. Psychosis prediction in secondary mental health services. A broad, comprehensive approach to the “at risk mental state” syndrome. Eur Psychiatry 40 (2017), 96–104.
38. Spada, G., Molteni, S., Pistone, C., Chiappedi, M., McGuire, P., Fusar-Poli, P., et al. Identifying children and adolescents at ultra high risk of psychosis in Italian neuropsychiatry services: a feasibility study. Eur Child Adolesc Psychiatry 25:1 (2016), 91–106.
39. Yung, A.R., Nelson, B., Stanford, C., Simmons, M.B., Cosgrave, E.M., Killackey, E., et al. Validation of “prodromal” criteria to detect individuals at ultra high risk of psychosis: 2 year follow-up. Schizophr Res 105:1–3 (2008), 10–17.
40. Kotlicka-Antczak, M., Pawełczyk, T., Rabe-Jabłońska, J., Pawełczyk, A., PORT (Programme of Recognition and Therapy): the first Polish recognition and treatment programme for patients with an at-risk mental state. Early Interv Psychiatry 9:4 (2015), 339–342.
41. Lee, J., Rekhi, G., Mitter, N., Bong, Y.L., Kraus, M.S., Lam, M., et al. The Longitudinal Youth at Risk Study (LYRIKS) – an Asian UHR perspective. Schizophr Res 151:1–3 (2013), 279–283.
42. Woods, S.W., Addington, J., Cadenhead, K.S., Cannon, T.D., Cornblatt, B.A., Heinssen, R., et al. Validity of the prodromal risk syndrome for first psychosis: findings from the North American Prodrome Longitudinal Study. Schizophr Bull 35:5 (2009), 894–908.
43. Addington, J., Piskulic, D., Perkins, D., Woods, S.W., Liu, L., Penn, D.L., Affect recognition in people at clinical high risk of psychosis. Schizophr Res 140:1–3 (2012), 87–92.
44. Liu, C.-C., Lai, M.-C., Liu, C.-M., Chiu, Y.-N., Hsieh, M.H., Hwang, T.-J., et al. Follow-up of subjects with suspected pre-psychotic state in Taiwan. Schizophr Res 126:1–3 (2011), 65–70.
45. Schultze-Lutter, F., Klosterkötter, J., Ruhrmann, S., Improving the clinical prediction of psychosis by combining ultra-high risk criteria and cognitive basic symptoms. Schizophr Res 154:1–3 (2014), 100–106.
46. Simon, A.E., Grädel, M., Cattapan-Ludewig, K., Gruber, K., Ballinari, P., Roth, B., et al. Cognitive functioning in at-risk mental states for psychosis and 2-year clinical outcome. Schizophr Res 142:1–3 (2012), 108–115.
47. Thomas, C., Hyppönen, E., Power, C., Type 2 diabetes mellitus in midlife estimated from the Cambridge Risk Score and body mass index. Arch Intern Med 166:6 (2006), 682–688.
48. Fusar-Poli, P., Cappucciati, M., Borgwardt, S., Woods, S.W., Addington, J., Nelson, B., et al. Heterogeneity of psychosis risk within individuals at clinical high risk: a meta-analytical stratification. JAMA Psychiatry 73:2 (2016), 113–120.
49. Fusar-Poli, P., Rutigliano, G., Stahl, D., Schmidt, A., Ramella-Cravaro, V., Hitesh, S., et al. Deconstructing pretest risk enrichment to optimize prediction of psychosis in individuals at clinical high risk. JAMA Psychiatry 73:12 (2016), 1260–1267.
50. Fusar-Poli, P., Schultze-Lutter, F., Cappucciati, M., Rutigliano, G., Bonoldi, I., Stahl, D., et al. The dark side of the moon: meta-analytical impact of recruitment strategies on risk enrichment in the clinical high risk state for psychosis. Schizophr Bull 42:3 (2016), 732–743.
51. Fusar-Poli, P., Palombini, E., Davies, C., Oliver, D., Bonoldi, I., Ramella-Cravaro, V., et al. Why transition risk to psychosis is not declining at the OASIS ultra high risk service: the hidden role of stable pretest risk enrichment. Schizophr Res S0920-9964:17 (2017), 30353–30355.
52. Fusar-Poli, P., Bonoldi, I., Yung, A.R., Borgwardt, S., Kempton, M.J., Valmaggia, L., et al. Predicting psychosis: meta-analysis of transition outcomes in individuals at high clinical risk. Arch Gen Psychiatry 69:3 (2012), 220–229.
53. Fusar-Poli, P., Cappucciati, M., De Micheli, A., Rutigliano, G., Bonoldi, I., Tognin, S., et al. Diagnostic and prognostic significance of brief limited intermittent psychotic symptoms (BLIPS) in individuals at ultra high risk. Schizophr Bull 43:1 (2017), 48–56.
54. Ramella-Cravaro, V., Radua, J., Ionnidis, J.P.A., Reichenberg, A., Phiphopthatsanee, N., Amir, T., et al. What causes psychosis? Umbrella review of risk factors. World Psychiatry, 2017 (In Press).
55. Fusar-Poli, P., Tantardini, M., De Simone, S., Ramella-Cravaro, V., Oliver, D., Kingdon, J., et al. Deconstructing vulnerability for psychosis: meta-analysis of environmental risk factors for psychosis in subjects at ultra high-risk. Eur Psychiatry 40 (2017), 65–75.