Psychometrics of the personal questionnaire: A client-generated outcome measure

Psychological Assessment

Volumn 28, Issue 3, 2016, Pages 263-278

  Elliott, Robert ^a   Wagner, John ^b   Sales, Célia M D ^c   Rodgers, Brian ^d,f   Alves, Paula ^c   Café, Maria J ^e  

^a UNIVERSITY OF STRATHCLYDE   (United Kingdom)

^b Dialectical Behaviour Therapy Centre of Vancouver Inc   (Canada)

^c INSTITUTO UNIVERSITÁRIO DE LISBOA ISCTE IUL   (Portugal)

^d UNIVERSITY OF QUEENSLAND   (Australia)

^e Portuguese Association of Family and Community Therapy   (Portugal)

^f AUCKLAND UNIVERSITY OF TECHNOLOGY   (New Zealand)

Author keywords

Individualized; Measurement; Outcome; Psychometrics; Psychotherapy

Indexed keywords

ADULT; ARTICLE; CLINICAL TRIAL (TOPIC); CONSTRUCT VALIDITY; CONVERGENT VALIDITY; DISEASE SEVERITY; DISTRESS SYNDROME; EVIDENCE BASED PRACTICE; FEMALE; GENERALIZED ANXIETY DISORDER; HUMAN; INTERNAL CONSISTENCY; MAJOR CLINICAL STUDY; MAJOR DEPRESSION; MALE; OUTCOME ASSESSMENT; PERSONAL QUESTIONNAIRE; PILOT STUDY; PORTUGAL; PSYCHOMETRY; PSYCHOTHERAPY; QUESTIONNAIRE; SELF REPORT; SENSITIVITY ANALYSIS; SOCIAL PHOBIA; TEST RETEST RELIABILITY; TIME SERIES ANALYSIS; UNITED KINGDOM; UNITED STATES; REPRODUCIBILITY; SCOTLAND; STANDARDS; STATISTICS AND NUMERICAL DATA;

ADULT; FEMALE; HUMANS; MALE; OUTCOME ASSESSMENT (HEALTH CARE); PORTUGAL; PSYCHOMETRICS; PSYCHOTHERAPY; REPRODUCIBILITY OF RESULTS; SCOTLAND; SURVEYS AND QUESTIONNAIRES; UNITED STATES;

EID: 84930915528     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000174     Document Type: Article

References (75)

1. Accurso, E. C., Hawley, K. M., & Garland, A. F. (2013). Psychometric properties of the Therapeutic Alliance Scale for Caregivers and Parents. Psychological Assessment, 25, 244 -252. http://dx.doi.org/10.1037/ a0030551
2. Allport, G. (1937). Personality: A psychological interpretation. New York:Holt.
3. Allport, G. (1960). Personality and social encounter. Boston: Beacon Press.
4. Alves, P. C. G., Sales, C. M. D., & Ashworth, M. (2013). Enhancing the patient involvement in outcomes: A study protocol of personalised outcome measurement in the treatment of substance misuse. BMC Psychiatry, 13, 337-349. http://dx.doi.org/10.1186/1471-244X-13-337
5. American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.
6. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
7. Ashworth, M., Robinson, S., Evans, C., Shepherd, M., Conolly, A., & Rowlands, G. (2007). What does an idiographic measure (PSYCHLOPS) tell us about the spectrum of psychological issues and scores on a nomothetic measure (CORE-OM)? Primary Care & Community Psychiatry, 12, 7-16.
8. Ashworth, M., Shepherd, M., Christey, J., Matthews, V., Wright, K., Parmentier, H.,... Godfrey, E. (2004). A client-centred psychometric instrument: The development of PSYCHLOPS. Counselling & Psychotherapy Research, 4, 27-31. http://dx.doi.org/10.1080/ 14733140412331383913
9. Barkham, M., Rees, A., Stiles, W. B., Shapiro, D. A., Hardy, G. E., & Reynolds, S. (1996). Dose-effect relations in time-limited psychotherapy for depression. Journal of Consulting and Clinical Psychology, 64, 927-935. http://dx.doi.org/10.1037/0022-006X.64.5.927
10. Barkham, M., Shapiro, D. A., & Firth-Cozens, J. (1989). Personal questionnaire changes in prescriptive vs. exploratory psychotherapy. British Journal of Clinical Psychology, 28, 97-107. http://dx.doi.org/10.1111/j .2044-8260.1989.tb00820.x
11. Barkham, M., Shapiro, D. A., & Morrison, L. (1988). Classification of psychological problems elicited by the Personal Questionnaire technique:A coding manual. Sheffield, England: University of Sheffield, MRC/ESRC Social and Applied Psychology Unit.
12. Barkham, M., Stiles, W. B., & Shapiro, D. A. (1993). The shape of change in psychotherapy: Longitudinal assessment of personal problems. Journal of Consulting and Clinical Psychology, 61, 667-677. http://dx.doi .org/10.1037/0022-006X.61.4.667
13. Bates, D., Mächler, M., Bolker, B. M., & Walker, S. (2014). Fitting linear mixed-effects models using lme4. Retrieved from http://arxiv.org/abs/ 1406.5823
14. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. New York: Wiley. http://dx.doi.org/ 10.1002/9780470743386
15. Carvalho, M. J., Faustino, I., Nascimento, A., & Sales, C. M. D. (2008). Understanding Pamina's recovery: An application of the hermeneutic single-case efficacy design. Counselling & Psychotherapy Research, 8, 166-173. http://dx.doi.org/10.1080/14733140802211002
16. Connell, J., Barkham, M., Stiles, W. B., Twigg, E., Singleton, N., Evans, O., & Miles, J. N. V. (2007). Distribution of CORE-OM scores in a general population, clinical cut-off points and comparison with the CIS-R. British Journal of Psychiatry, 190, 69-74. http://dx.doi.org/ 10.1192/bjp.bp.105.017657
17. Connor, K. M., Davidson, J. R. T., Churchill, L. E., Sherwood, A., Foa, E., & Weisler, R. H. (2000). Psychometric properties of the Social Phobia Inventory (SPIN). New self-rating scale. British Journal of Psychiatry, 176, 379-386. http://dx.doi.org/10.1192/bjp.176.4.379
18. CORE System Group. (1998). CORE Systems (information management) handbook. Rugby, UK: Author.
19. Costa, P. T., & McCrae, R. R. (1992). The NEO PI-R. Odessa, FL:Psychological Assessment Resources.
20. Derogatis, L. R. (1983). SCL-90-R administration, scoring and procedures manual-II. Towson, MD: Clinical Psychometric Research.
21. Durbin, C. E., & Klein, D. N. (2006). Ten-year stability of personality disorders among outpatients with mood disorders. Journal of Abnormal Psychology, 115, 75-84. http://dx.doi.org/10.1037/0021-843X.115.1.75
22. Egan, V., Miller, E., & McLellan, I. (1998). Does the personal questionnaire provide a more sensitive measure of cardiac surgery relatedanxiety than a standard pencil-and-paper checklist? Personality and Individual Differences, 24, 465-473. http://dx.doi.org/10.1016/S0191-8869(97)00192-X
23. Elliott, R. (2001). Research on the effectiveness of humanistic therapies: A meta-analysis. In D. Cain & J. Seeman (Eds.), Humanistic psychotherapies:Handbook of research and practice (pp. 57-81). Washington, DC: American Psychological Association.
24. Elliott, R., Fox, C. M., Beltyukova, S. A., Stone, G. E., Gunderson, J., & Zhang, Xi. (2006). Deconstructing therapy outcome measurement with Rasch analysis: The Symptom Checklist-90-Revised. Psychological Assessment, 18, 359-372. http://dx.doi.org/10.1037/1040-3590.18.4.359
25. Elliott, R., Mack, C., & Shapiro, D. (1999). Simplified Personal Questionnaire procedure. Retrieved from http://www.experiential-researchers .org/instruments/elliott/pqprocedure.html
26. Elliott, R., Partyka, R., Alperin, R., Dobrenski, R., Wagner, J., Messer, S. B.,... Castonguay, L. G. (2009). An adjudicated hermeneutic single-case efficacy design study of experiential therapy for panic/ phobia. Psychotherapy Research, 19, 543-557. http://dx.doi.org/ 10.1080/10503300902905947
27. Elliott, R., Watson, J. C., Goldman, R. N., & Greenberg, L. S. (2004). Learning emotion-focused therapy: The process-experiential approach to change. Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10725-000
28. Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE-OM. British Journal of Psychiatry, 180, 51-60. http://dx.doi.org/10.1192/bjp.180.1.51
29. Faur, A., & Elliott, R. (2007). Self-Relationship Questionnaire. Unpublished questionnaire, University of Strathclyde, Glasgow, Scotland.
30. Finn, S. E., & Tonsager, M. E. (1997). Information-gathering and therapeutic models of assessment: Complementary paradigms. Psychological Assessment, 9, 374-385. http://dx.doi.org/10.1037/1040-3590.9.4.374
31. First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1997). Structured Clinical Interview for DSM-IV Personality Disorders (SCIDII). Washington, DC: American Psychiatric Press.
32. First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2002). Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Non-patient Edition (SCID-I/NP). New York: Biometrics Research, New York State Psychiatric Institute.
33. Fischer, C. T. (1994). Individualizing psychological assessment. Hillsdale, NJ: Erlbaum.
34. Freire, E. S. (2007). Development of a psychotherapy outcome measure based on Rogers' theory of therapy change. Unpublished MSc thesis, University of Strathclyde, Glasgow, Scotland.
35. Glass, G. V., Willson, V. L., & Gottman, J. M. (1975). Design and analysis of time-series experiments. Boulder: Colorado Associated University Press.
36. Good, P. (2006). Resampling methods (3rd ed.). Boston: Birkhauser.
37. Gorsuch, R. L. (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment, 68, 532-560. http://dx.doi.org/ 10.1207/s15327752jpa6803_5
38. Grafanaki, S., & McLeod, J. (1999). Narrative processes in the construction of helpful and hindering events in experiential psychotherapy. Psychotherapy Research, 9, 289 -303. http://dx.doi.org/10.1080/ 10503309912331332771
39. Horowitz, L. M., Rosenberg, S. E., Baer, B. A., Ureño, G., & Villaseñor, V. S. (1988). Inventory of Interpersonal Problems: Psychometric properties and clinical applications. Journal of Consulting and Clinical Psychology, 56, 885- 892. http://dx.doi.org/10.1037/0022-006X.56.6.885
40. Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29-51. http://dx.doi.org/10.1146/ annurev.clinpsy.3.022806.091419
41. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19. http://dx.doi .org/10.1037/0022-006X.59.1.12
42. Kiesler, D. J. (1966). Some myths of psychotherapy research and the search for a paradigm. Psychological Bulletin, 65, 110-136. http://dx .doi.org/10.1037/h0022911
43. Kiresuk, T. J., & Sherman, R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4, 443-453. http://dx.doi .org/10.1007/BF01530764
44. Klein, M. J., & Elliott, R. (2006). Client accounts of personal change in process-experiential psychotherapy: A methodologically pluralistic approach. Psychotherapy Research, 16, 91-105. http://dx.doi.org/10.1080/ 10503300500090993
45. Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9. Journal of General Internal Medicine, 16, 606-613. http://dx.doi.org/ 10.1046/j.1525-1497.2001.016009606.x
46. Lambert, M. J., & McRoberts, C. (1993, April). Survey of outcome measures used in JCCP 1986-1991. Poster session presented at the Annual Meeting of the Western Psychological Association, Phoenix, AZ.
47. Ledesma, R. D., & Valero-Mora, P. (2007). Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research & Evaluation, 12, 1-11.
48. MacLeod, R., Elliott, R., & Rodgers, B. (2012). Process-experiential/ emotion-focused therapy for social anxiety: A hermeneutic single-case efficacy design study. Psychotherapy Research, 22, 67-81. http://dx.doi .org/10.1080/10503307.2011.626805
49. Maling, M. S., Gurtman, M. B., & Howard, K. I. (1995). The response of interpersonal problems to varying doses of psychotherapy. Psychotherapy Research, 5, 63-75. http://dx.doi.org/10.1080/ 10503309512331331146
50. McLeod, J. (2010). Case study research in counselling and psychotherapy. London: Sage.
51. McPherson, F. M., & Le Gassicke, J. (1965). A single-patient, selfcontrolled and self-recorded trial of Wy 3498. British Journal of Psychiatry, 111, 149-154. http://dx.doi.org/10.1192/bjp.111.471.149
52. Messer, B., & Harter, S. (1986). Manual for the Adult Self-Perception Profile. Denver, CO: University of Denver.
53. Mintz, J., & Kiesler, D. (1982). Individualized measures of psychotherapy outcome. In P. Kendall & J. N. Butcher (Eds.), Handbook of research methods in clinical psychology (pp. 491-534). New York: Wiley.
54. O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, & Computers, 32, 396-402. http://dx.doi.org/10.3758/BF03200807
55. Ogles, B., Lambert, M., & Masters, K. (1996). Assessing outcome in clinical practice. Boston: Allyn & Bacon.
56. Pascal, G. R., & Zax, M. (1956). Psychotherapeutics: Success or failure. Journal of Consulting Psychology, 20, 325-331. http://dx.doi.org/ 10.1037/h0040582
57. Phillips, J. P. N. (1986). Shapiro Personal Questionnaire and generalized personal questionnaire technique: A repeated measures individualized outcome measurement. In L. Greenberg & W. Pinsof (Eds.), The psychotherapeutic process: A research handbook (pp. 557-589). New York: Guilford Press.
58. R Core Team. (2012). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
59. Rickard, H. C. (1965). Tailored criteria of change in psychotherapy. Journal of General Psychology, 72, 63-68.
60. Robins, L. N., Helzer, J. E., Croughan, J., & Ratcliff, K. S. (1981). National Institute of Mental Health Diagnostic Interview Schedule: Its history, characteristics, and validity. Archives of General Psychiatry, 38, 381-389. http://dx.doi.org/10.1001/archpsyc.1981.01780290015001
61. Rush, J., & Hofer, S. M. (2014). Differences in within- and between-person factor structure of positive and negative affect: Analysis of two intensive measurement studies using multilevel structural equation modeling. Psychological Assessment, 26, 462- 473. http://dx.doi.org/10.1037/ a0035666
62. Sales, C. M. D., & Alves, P. C. G. (2012). Individualized patient-progress systems: Why we need to move towards a personalized evaluation of psychological treatments. Canadian Psychology/Psychologie canadienne, 53, 115-121. http://dx.doi.org/10.1037/a0028053
63. Sales, C. M. D., & Alves, P. C. G. (2014). Psychotherapy through the eyes of patients: A review of assessment tools. Manuscript submitted for publication.
64. Sales, C. M. D., Alves, P. C. G., Evans, C., & Elliott, R. (2014). The Individualized Patient Progress System (IPPS): A decade of international collaborative networking. Counselling & Psychotherapy Research, 14, 181-191. http://dx.doi.org/10.1080/14733145.2014.929417
65. Sales, C. M. D., Gonçalves, S., Silva, I. F., Duarte, J., Sousa, D., Fernandes, E.,... Elliott, R. (2007, March). Portuguese adaptation of qualitative change process instruments. Paper presented at the European Chapter Meeting of the Society for Psychotherapy Research, Funchal, Portugal.
66. Sales, C. M. D., Moleiro, C., Evans, C., & Alves, P. C. G. (2012). Versão Portuguesa do CORE-OM: Tradução, adaptação e estudo preliminar das suas propriedades psicométricas [Portuguese translation of CORE-OM:Translation, adaptation and preliminary study of its psychometric properties]. Revista de Psiquiatria Clínica, 39, 54-59. http://dx.doi.org/ 10.1590/S0101-60832012000200003
67. Sales, C. M. D., & Wakker, P. P. (2009). The metric-frequency measure of similarity for ill-structured data sets, with an application to family therapy. British Journal of Mathematical and Statistical Psychology, 62, 663-682. http://dx.doi.org/10.1348/000711008X376070
68. Sales, C. M. D., Wakker, P., Alves, P., & Faísca, L. (in press). MF calculator: A web-based application for analyzing similarity. Journal of Statistical Software.
69. Shapiro, M. B. (1961). A method of measuring psychological changes specific to the individual psychiatric patient. British Journal of Medical Psychology, 34, 151-155. http://dx.doi.org/10.1111/j.2044-8341.1961.tb00940.x
70. Shapiro, M. B. (1969). Short-term improvements in the symptoms of affective disorder. British Journal of Social & Clinical Psychology, 8, 187-188. http://dx.doi.org/10.1111/j.2044-8260.1969.tb00606.x
71. Snijders, T. A. B., & Bosker, R. J. (2011). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). London:Sage.
72. Tang, T. Z., & DeRubeis, R. J. (1999). Sudden gains and critical sessions in cognitive- behavioral therapy for depression. Journal of Consulting and Clinical Psychology, 67, 894-904. http://dx.doi.org/10.1037/0022-006X.67.6.894
73. Vieira, F., Torres, S., & Moita, G. (2011, September). Psychological intervention in obesity: Psychodramatic approach. Paper presented at the Fourth Regional Mediterranean Congress of the International Association for Group Psychotherapy and Group Processes, Porto, Portugal.
74. Waskow, I. E., & Parloff, M. B. (1975). Psychotherapy change measures. Rockville, MD: National Institute of Mental Health.
75. Wing, J. K., Cooper, J. E., & Sartorius, N. (1974). Measurement and classification of psychiatric symptoms: An instruction manual for the PSE and Catego Program. New York: Cambridge University Press.