Reference values for mental health assessment instruments: Objectives and methods of the Leiden Routine Outcome Monitoring Study

Journal of Evaluation in Clinical Practice

Volumn 19, Issue 2, 2013, Pages 342-350

  Schulte Van Maaren, Yvonne W M ^a,b   Carlier, Ingrid V E ^a   Giltay, Erik J ^b   Van Noorden, Martijn S ^b   De Waal, Margot W M ^b   Van Der Wee, Nic J A ^b   Zitman, Frans G ^b  

^a Centre for Routine Outcome Monitoring   (Netherlands)

^b LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

anxiety disorders; depressive disorder; instruments; reference values; routine outcome monitoring; somatoform disorder

Indexed keywords

ADULT; AGE DISTRIBUTION; AGED; ANXIETY DISORDER; ARTICLE; CALIBRATION; CLINICAL PRACTICE; CONTROLLED STUDY; CROSS-SECTIONAL STUDY; FEMALE; GENERAL PRACTITIONER; HUMAN; INFORMATION PROCESSING; INTERVIEW; MAJOR CLINICAL STUDY; MAJOR DEPRESSION; MALE; MENTAL DISEASE; MENTAL HEALTH; MENTAL HEALTH CARE; NAMED INVENTORIES, QUESTIONNAIRES AND RATING SCALES; NETHERLANDS; PATIENT ASSESSMENT; PATIENT REFERRAL; PRIORITY JOURNAL; QUALITY CONTROL; RANDOMIZED CONTROLLED TRIAL; REFERENCE VALUE; ROUTINE OUTCOME MONITORING; SECONDARY HEALTH CARE; SOMATOFORM DISORDER;

ADOLESCENT; ADULT; AGED; CROSS-SECTIONAL STUDIES; FEMALE; HUMANS; MALE; MENTAL DISORDERS; MIDDLE AGED; NETHERLANDS; OUTCOME ASSESSMENT (HEALTH CARE); QUALITATIVE RESEARCH; REFERENCE VALUES; SEX DISTRIBUTION; YOUNG ADULT;

EID: 84874952875     PISSN: 13561294     EISSN: 13652753     Source Type: Journal    
DOI: 10.1111/j.1365-2753.2012.01830.x     Document Type: Article

References (57)

1. De Beurs, E., Den Hollander-Gijsman, M. E., Van Rood, Y. R., Van der Wee, N. J., Giltay, E. J., Van Noorden, M. S., Van der Lem, R., Van Fenema, E., &, Zitman, F. G., (2011) Routine outcome monitoring in the Netherlands: practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clinical Psychology and Psychotherapy, 18, 1-12.
2. Lambert, M., (2007) Presidential address: what we have learned from a decade of research aimed at improving psychotherapy outcome in routine care. Psychotherapy Research, 17 (1), 1-14.
3. Miller, S. D., Duncan, B. L., Sorrell, R., &, Brown, G. S., (2005) The partners for change outcome management system. Journal of Clinical Psychology, 61 (2), 199-208.
4. Bijl, R. V., Ravelli, A., &, van Zessen, G., (1998) Prevalence of psychiatric disorder in the general population: results of The Netherlands Mental Health Survey and Incidence Study (NEMESIS). Social Psychiatry and Psychiatric Epidemiology, 33 (12), 587-595.
5. Van Noorden, M. S., Giltay, E. J., Den Hollander-Gijsman, M. E., Van der Wee, N. J., Van Veen, T., &, Zitman, F. G., (2010) Gender differences in clinical characteristics in a naturalistic sample of depressive outpatients: the Leiden Routine Outcome Monitoring Study. Journal of Affective Disorders, 125 (1-3), 116-123.
6. Linnet, K., (2000) Nonparametric estimation of reference intervals by simple and bootstrap-based procedures. Clinical Chemistry, 46 (6 Pt 1), 867-869.
7. Overbeek, L. I., Kapusta, L., Peer, P. G., De Korte, C. L., Thijssen, J. M., &, Daniels, O., (2006) New reference values for echocardiographic dimensions of healthy Dutch children. European Journal of Echocardiography, 7 (2), 113-121.
8. Carlier, I. V., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J., &, Zitman, F. G., (2011) Routine outcome monitoring and feedback on physical or mental health status: evidence and theory. Journal of Evaluation in Clinical Practice 18 (1), 104-110.
9. Van Noorden, M. S., Minkenberg, S. E., Giltay, E. J., Den Hollander-Gijsman, M. E., Van Rood, Y. R., Van der Wee, N. J., &, Zitman, F. G., (2010) Pre-adult versus adult onset major depressive disorder in a naturalistic patient sample: the Leiden Routine Outcome Monitoring Study. Psychological Medicine, 16, 1-11.
10. Sullivan, P. F., Neale, M. C., &, Kendler, K. S., (2000) Genetic epidemiology of major depression: review and meta-analysis. American Journal of Psychiatry, 157 (10), 1552-1562.
11. Uhl, G. R., &, Grow, R. W., (2004) The burden of complex genetics in brain disorders. Archives of General Psychiatry, 61 (3), 223-229.
12. Carroll, B. J., Cassidy, F., Naftolowitz, D., Tatham, N. E., Wilson, W. H., Iranmanesh, A., Liu, P. Y., &, Veldhuis, J. D., (2007) Pathophysiology of hypercortisolism in depression. Acta Psychiatrica Scandinavica. Supplementum, 433, 90-103.
13. Pariante, C. M., &, Lightman, S. L., (2008) The HPA axis in major depression: classical theories and new developments. Trends in Neurosciences, 31 (9), 464-468.
14. Vreeburg, S. A., Hoogendijk, W. J., Van Pelt, J., Derijk, R. H., Verhagen, J. C., Van Dyck, R., Smit, J. H., Zitman, F. G., &, Penninx, B. W., (2009) Major depressive disorder and hypothalamic-pituitary-adrenal axis activity: results from a large cohort study. Archives of General Psychiatry, 66 (6), 617-626.
15. De Kloet, E. R., Joels, M., &, Holsboer, F., (2005) Stress and the brain: from adaptation to disease. Nature Reviews. Neuroscience, 6 (6), 463-475.
16. Vreeburg, S. A., Zitman, F. G., Van Pelt, J., Derijk, R. H., Verhagen, J. C., Van Dyck, R., Hoogendijk, W. J., Smit, J. H., &, Penninx, B. W., (2010) Salivary cortisol levels in persons with and without different anxiety disorders. Psychosomatic Medicine, 72 (4), 340-347.
17. Kendall, P. C., Marrs-Garcia, A., Nath, S. R., &, Sheldrick, R. C., (1999) Normative comparisons for the evaluation of clinical significance. Journal of Consulting and Clinical Psychology, 67 (3), 285-299.
18. Poortvliet, M. C., Lamkadden, M., &, Deville, W., Niet op naam ingeschreven (NONI) bij de huisarts. Inventarisatie en gevolgen voor de ziekenfondsverzekerden. NIVEL; 2005.
19. Horowitz, G. L., Altaie, S., Boyd, J. C., Ceriotti, F., Garg, U., Horn, P., Pesce, A., Sine, H. E., &, Zakowski, J., (2008) Defining, Establishing, and Verifying Reference Intervals in the Clinical Laboratory; Approved Guideline-Third Edition CLSI Document C28-A3. Wayne, PA: Clinical and Laboratory Standards Institute.
20. Nannya, Y., Taura, K., Kurokawa, M., Chiba, S., &, Ogawa, S., (2007) Evaluation of genome-wide power of genetic association studies based on empirical data from the HapMap project. Human Molecular Genetics, 16 (20), 2494-2505.
21. Penninx, B. W., Beekman, A. T., Smit, J. H., et al,. (2008) The Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods. International Journal of Methods in Psychiatric Research, 17 (3), 121-140.
22. Bourdon, K. H., Goodman, R., Rae, D. S., Simpson, G., &, Koretz, D. S., (2005) The strengths and difficulties questionnaire: U.S. normative data and psychometric properties. Journal of the American Academy of Child and Adolescent Psychiatry, 44 (6), 557-564.
23. Noerholm, V., Groenvold, M., Watt, T., Bjorner, J. B., Rasmussen, N. A., &, Bech, P., (2004) Quality of life in the Danish general population-normative data and validity of WHOQOL-BREF using Rasch and item response theory models. Quality of Life Research, 13 (2), 531-540.
24. Reedtz, C., Bertelsen, B., Lurie, J., Handegard, B. H., Clifford, G., &, Morch, W. T., (2008) Eyberg Child Behavior Inventory (ECBI): Norwegian norms to identify conduct problems in children. Scandinavian Journal of Psychology, 49 (1), 31-38.
25. Solberg, H. E., (2008) Establishment and use of reference values. In Fundamentals of Clinical Chemistry (eds, C. A. Burtis, E. R. Ashwood, &, D. E. Bruns,), pp. 229-238. 6 edn St. Louis, MO: Saunders Elsevier.
26. Barnabei, L., Marazia, S., &, De, C. R., (2007) Receiver operating characteristic (ROC) curves and the definition of threshold levels to diagnose coronary artery disease on electrocardiographic stress testing. Part I: the use of ROC curves in diagnostic medicine and electrocardiographic markers of ischaemia. Journal of Cardiovascular Medicine (Hagerstown, Md.), 8 (11), 873-881.
27. Kessler, R. C., McGonagle, K. A., Zhao, S., Nelson, C. B., Hughes, M., Eshleman, S., Wittchen, H. U., &, Kendler, K. S., (1994) Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States. Results from the National Comorbidity Survey. Archives of General Psychiatry, 51 (1), 8-19.
28. De Waal, M. W., Arnold, I. A., Eekhof, J. A., &, Van Hemert, A. M., (2004) Somatoform disorders in general practice: prevalence, functional impairment and comorbidity with anxiety and depressive disorders. The British Journal of Psychiatry; The Journal of Mental Science, 184, 470-476.
29. Smith, A. L., &, Weissman, M. M., (1992) Epidemiology. (ed, E. S. Paykel,), pp. 111-129. Handbook of Affective Disorders. New York: Guildford.
30. Reed, A. H., Henry, R. J., &, Mason, W. B., (1971) Influence of statistical method used on the resulting estimate of normal range. Clinical Chemistry, 17 (4), 275-284.
31. Horn, P. S., Feng, L., Li, Y., &, Pesce, A. J., (2001) Effect of outliers and nonhealthy individuals on reference interval estimation. Clinical Chemistry, 47 (12), 2137-2145.
32. Angoff, W. H., (1971) Scales, norms and equivalent scores. In Educational Measurement (ed., R. L. Thorndike,), pp. 508-600. Washington, DC: American Council on Education.
33. Bechger, T., Hemker, B., &, Maris, G., (2009) Over Het Gebruik Van Continue Normering. Arnhem: Cito.
34. Zimmerman, M., &, Mattia, J. I., (1999) Psychiatric diagnosis in clinical practice: is comorbidity being missed? Comprehensive Psychiatry, 40 (3), 182-191.
35. Bernstein, D. P., Stein, J. A., Newcomb, M. D., et al,. (2003) Development and validation of a brief screening version of the Childhood Trauma Questionnaire. Child Abuse & Neglect, 27 (2), 169-190.
36. Endicott, J., Spitzer, R. L., Fleiss, J. L., &, Cohen, J., (1976) The global assessment scale. A procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33 (6), 766-771.
37. Scheier, M. F., Carver, C. S., &, Bridges, M. W., (1994) Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem)-a reevaluation of the Life Orientation Test. Journal of Personality and Social Psychology, 67 (6), 1063-1078.
38. Ware, J. E., Snow, K. K., &, Kosinski, M., (1993) SF-36 Health Survey Manual and Interpretation Guide. Boston, MA: New England Medical center, The Health Institute.
39. DeRogatis, L. R., (1975) The Brief Symptom Inventory. Baltimore, MD: Clinical Psychometric Research.
40. Livesley, W. J., &, Jackson, D. N., (2002) Manual for the Dimensional Assessment of Personality Pathology-Basic Questionnaire (DAPPBQ). Port Huron, MI: Sigma Press.
41. Horowitz, M. J., Wilner, N. R., &, Alvarez, W., (1979) Impact of Event Scale: a measure of subjective stress. Psychosomatic Medicine, 41, 209-218.
42. Creamer, M., Bell, R., &, Failla, S., (2003) Psychometric properties of the impact of event scale-revised. Behaviour Resarch and Therapy, 41 (12), 1489-1496.
43. Clark, L. A., &, Watson, D., (1991) Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100 (3), 316-336.
44. Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., Weiller, E., Hergueta, T., Baker, R., &, Dunbar, G. C., (1998) The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59, 22-33.
45. Asberg, M., Montgomery, S. A., Perris, C., Schalling, D., &, Sedvall, G., (1978) A comprehensive psychopathological rating scale. Acta Psychiatrica Scandinavica. Supplementum, 271, 5-27.
46. Donker, T., Van Straten, A., Marks, I., &, Cuijpers, P., (2009) A brief web-based screening questionnaire for common mental disorders: development and validation. Journal of Medical Internet Research, 11 (3), e19.
47. Rush, A. J., Gullion, C. M., Basco, M. R., Jarrett, R. B., &, Trivedi, M. H., (1996) The Inventory of Depressive Symptomatology (IDS): psychometric properties. Psychological Medicine, 26 (3), 477-486.
48. Beck, A. T., &, Steer, R. A., (1984) Internal consistencies of the original and revised beck depression inventory. Journal of Clinical Psychology, 40 (6), 1365-1367.
49. Ost, L. G., (1990) The agoraphobia scale-an evaluation of its reliability and validity. Behaviour Research and Therapy, 28 (4), 323-329.
50. Sanavio, E., (1988) Obsessions and compulsions-the Padua Inventory. Behaviour Research and Therapy, 26 (2), 169-177.
51. Telch, M. J., Brouillard, M., Telch, C. F., Agras, W. S., &, Taylor, C. B., (1989) Role of cognitive appraisal in panic-related avoidance. Behaviour Research and Therapy, 27 (4), 373-383.
52. Meyer, T. J., Miller, M. L., Metzger, R. L., &, Borkovec, T. D., (1990) Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 28 (6), 487-495.
53. Beidel, D. C., Turner, S. M., Stanley, M. A., &, Dancu, C. V., (1989) The social phobia and anxiety inventory-concurrent and external validity. Behavior Therapy, 20 (3), 417-427.
54. Tallis, F., Eysenck, M., &, Mathews, A., (1992) A questionnaire for the measurement of nonpathological worry. Personality and Individual Differences, 13 (2), 161-168.
55. Littleton, H. L., Axsom, D., &, Pury, C. L. S., (2005) Development of the body image concern inventory. Behaviour Research and Therapy, 43 (2), 229-241.
56. Vercoulen, J. H., Swanink, C. M., Fennis, J. F., Galama, J. M., van der Meer, J. W., &, Bleijenberg, G., (1994) Dimensional assessment of chronic fatigue syndrome. Journal of Psychosomatic Research, 38 (5), 383-392.
57. Pilowsky, I., (1967) Dimensions of hypochondriasis. British Journal of Psychiatry, 113 (494), 89-93.