Measures That Make a Difference: A Functional Contextualistic Approach to Optimizing Psychological Measurement in Clinical Research and Practice

The Wiley Handbook of Contextual Behavioral Science

Volumn , Issue , 2015, Pages 320-346

  Ciarrochi, Joseph ^a   Zettle, Robert D ^b   Brockman, Robert ^a   Duguid, James ^a   Parker, Philip ^a   Sahdra, Baljinder ^a   Kashdan, Todd B ^c  

^a AUSTRALIAN CATHOLIC UNIVERSITY   (Australia)

^b WICHITA STATE UNIVERSITY   (United States)

^c GEORGE MASON UNIVERSITY   (United States)

Author keywords

Behavioral framework; Classic psychometric theory; Clinical assessment; Contextual behavioral measurement; Therapeutic change; Treatment utility

Indexed keywords

EID: 84976891168     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118489857.ch16     Document Type: Chapter

References (84)

1. American Educational Research Association (1999). Standards for educational and psychological testing. Washington, DC: Author.
2. Anastasi, A, & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle, NJ: Pearson.
3. Andre, F., Bachelot, T., Commo, F., Campone, M., Arnedos, M., Dieras, V., ... Bonnefoi, H. (2014). Comparative genomic hybridisation array and DNA sequencing to direct treatment of metatastic breast cancer: A multicentre, prospective trial (SAFIRO1/UNICANCER). Lancet Oncology, 15, 267-274.
4. Appelhans, B. M., & Luecken, L. J. (2006). Heart rate variability as an index of regulated emotional responding. Review of General Psychology, 10, 229-240.
5. Barnes-Holmes, D., Barnes-Holmes, Y., Stewart, I., & Boles, S. (2010). A sketch of the implicit relational assessment procedure (IRAP) and the relational elaboration and coherence model (REC). The Psychological Record, 60, 527-542.
6. Barnes-Holmes, D., Murtagh, L., Barnes-Holmes, Y., & Stewart, I. (2010). Using the Implicit Association Test and the Implicit Relational Assessment Procedure to measure attitudes towards meat and vegetables in vegetarians and meat-eaters. The Psychological Record, 60, 287-306.
7. Beck, J. S. (1995). Cognitive therapy: Basics and beyond. New York, NY: Guilford.
8. Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979). Cognitive therapy of depression. New York, NY: Guilford.
9. Beck, A. T., Weissman, A., Lester, D., & Trexler, L. (1974). Measurement of pessimism: The Hopelessness Scale. Journal of Consulting and Clinical Psychology, 42, 861-865.
10. Bieling, P. J., Beck, A. T., & Brown, G. K. (2000). The Sociotropy-Autonomy Scale: Structure and implications. Cognitive Therapy and Research, 24, 763-780.
11. Bond, F. W., Flaxman, P. E., & Bunce, D. (2008). The influence of psychological flexibility on work redesign: Mediated moderation of a work reorganization intervention. Journal of Applied Psychology, 93, 645-634.
12. Bullock, J., Green, D., & Ha, S. (2010). Yes, but what's the mechanism? (Don't expect an easy answer). Journal of Personality and Social Psychology, 98, 550-558.
13. Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A., & Kaemmer, B. (1989). Minnesota Multiphasic Personality Inventory-2 (MMPI-2): Manual for administration and scoring. Minneapolis, MN: University of Minnesota Press.
14. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
15. Carpenter, K. M., Martinez, D., Vadhan, N., Barnes-Holmes, D., & Nunes, E. V. (2012). Measures of attentional bias and relational responding are associated with behavioral treatment outcome for cocaine dependence. The American Journal of Drug and Alcohol Abuse, 38, 146-154.
16. Ciarrochi, J., & Bailey, A. (2008). A CBT-practicioner's guide to ACT: How to bridge the gap between cognitive behavioral therapy and acceptance and commitment therapy. Oakland, CA: New Harbinger.
17. Ciarrochi, J., Bailey, A., & Harris, R. (2014). The weight escape. Sydney, Australia: Penguin.
18. Ciarrochi, J. Bilich, L., & Godsel, C. (2010). Psychological flexibility as a mechanism of change in acceptance and commitment therapy. In R. Baer (Ed.), Assessing mindfulness and acceptance: Illuminating the processes of change (pp. 51-76). Oakland, CA: New Harbinger.
19. Cohen, L. H., Gunthert, K., Butler, A., Parrish, B., Wenze, S., & Beck, J. (2008). Negative affective spillover from daily events predicts early response to cognitive therapy for depression. Journal of Consulting and Clinical Psychology, 76, 955.
20. Cullen, C., Barnes-Holmes, D., & Barnes-Holmes, Y. (2009). The implicit relational assessment procedure (IRAP) and the malleability of ageist attitudes. The Psychological Record, 59, 591-620.
21. Dalrymple, K. L., & Herbert, J. D. (2007). Acceptance and commitment therapy for generalized social anxiety disorder: A pilot study. Behavior Modification, 31, 543-568.
22. Delespaul, P., & van Os, J. (2002). Determinants of occurrence and recovery from hallucinations in daily life. Social Psychiatry and Psychiatric Epidemiology, 37, 97-104.
23. English, C. L., & Anderson, C. M. (2006). Evaluation of the treatment utility of the analog functional analysis and the structured descriptive assessment. Journal of Positive Behavior Interventions, 8, 212-229.
24. Eysenck, H. J. (1959). Review of the Rorschach Inkblot Test. In O. K. Buros (Ed.), The fifth mental measurements yearbook (pp. 276-278). Highland Park, NJ: Gryphon Press.
25. Farber, B. A., Berano, K. C., & Capobianco, J. A. (2004). Clients' perceptions of the process and consequences of self-disclosure in psychotherapy. Journal of Counseling Psychology, 51, 340-346.
26. Ferster, C. (1965). Classification of behavior pathology. In L. Krasner & L. P. Ullman (Eds.), Research in behavior modification (pp. 6-26). New York, NY: Holt, Rinehart & Winston.
27. Forman, E. M., Butryn, M. L., Juarascio, A. S., Bradley, L. E., Lowe, M. R., Herbert, J. D., & Shaw, J. A. (2013). The Mind Your Health Project: A randomized controlled trial of an innovative behavioral treatment for obesity. Obesity, 21, 1119-1126.
28. Greenwald, A., McGhee, D., & Schwartz, J. (1998). Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology, 74, 1464-1480.
29. Gross, J. (1998). The emerging field of emotion regulation: An integrative review. Review of General Psychology, 2, 271-299.
30. Gross, J. (2002). Emotion regulation: Affective, cognitive and social consequences. Psychophysiology, 39, 281-291.
31. Haeffel, G., & Howard, G. (2010). Self-report: Psychology's four-letter word. American Journal of Psychology, 123, 181-188.
32. Hayes, S. C., Barnes-Holmes, D., & Roche, B. (Eds.). (2001). Relational frame theory: A post-Skinnerian account of human language and cognition. New York: Kluwer/Plenum.
33. Hayes, S. C., Barnes-Holmes, D., & Wilson, K. G. (2012). Contextual behavioral science:Creating a science more adequate to the challenge of the human condition. Journal of Contextual Behavioral Science 1, 1-16.
34. Hayes, S. C., Nelson, R. O., & Jarrett, R. B. (1986). Evaluating the quality of behavioral assessment. In R. O. Nelson & S. C. Hayes (Eds.), Conceptual foundations of behavioral assessment (pp. 461-503). New York, NY; Guilford.
35. Hayes, S. C., Nelson, R. O., & Jarrett, R. B. (1987). The treatment utility of assessment:A functional approach to evaluating assessment quality. American Psychologist, 42, 963-974.
36. Hayes, S. C., Strosahl, K., & Wilson, K. G. (2012). Acceptance and commitment therapy:The process and practice of mindful change (2nd ed.). New York, NY: Guilford.
37. Heron, K. E., & Smyth, J. M. (2010). Ecological momentary interventions: Incorporating mobile technology into psychosocial and health behaviour treatments. British Journal of Health Psychology, 15, 1-39.
38. Hooper, D., Coughlan, J., & Mullen, M. (2008). Structural equation modeling guidelines for determining model fit. Electronic Journal of Business Research Methods, 6, 53-60.
39. Hooper, N., Villatte, M., Neofotistou, E., & McHugh, L. (2010). The effects of mindfulness versus thought suppression on implict and explict measures of experiential avoidance. The International Journal of Behavioral Consultation and Therapy, 6, 233-243.
40. Hughes, S., & Barnes-Holmes, D. (2011). On the formation and persistence of implicit attitudes:New evidence from the Implicit Relational Assessment Procedure. The Psychological Record, 61, 391-410.
41. Hunsley, J., & Bailey, J. M. (1999). The clinical utility of the Rorschach: Unfulfilled promises and an uncertain future. Psychological Assessment, 11, 266-277.
42. Hussey, I., & Barnes-Holmes, D. (2012). The implicit relational assessment procedure as a measure of implicit depression and the role of psychological flexibility. Cognitive and Behavioral Practice, 19, 573-582.
43. Iwata, B. A., Dorsey, M. F., Slifer, K. J., Bauman, K. E., & Richman, G. S. (1982). Toward a functional analysis of self-injury. Analysis and Intervention in Developmental Disabilities, 2, 3-20.
44. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
45. Jensen, A. R. (1965). Review of the Rorschach Inkblot Test. In O. K. Buros (Ed.), The sixth mental measurements yearbook (pp. 501-509). Highland Park, NJ: Gryphon Press.
46. Juarascio, A., Forman, E., Timko, C. A., Herbert, J., Butryn, M., & Lowe, M. (2011). Implicit internalization of the thin ideal as a predictor of increases in weight, body dissatisfaction and disordered eating. Eating Behaviors 12, 207-213.
47. Kashdan, T. B., & Ciarrochi, J. (Eds.). (2013). Mindfulness, acceptance, and positive psychology:The seven foundations of well-being. Oakland, CA: New Harbinger.
48. Kashdan, T. B., Ferssizidis, P., Collins, R. L., & Muraven, M. (2010). Emotion differentiation as resilience against excessive alcohol use: An ecological momentary assessment in underage social drinkers. Psychological Science, 21, 1341-1347.
49. Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3, 1-27.
50. Kemp, A., & Quintana, D. (2013). The relationship between mental and physical health:Insights from the study of heart rate variability. International Journal of Psychophysiology, 89, 288-296.
51. Klerman, G. L., Weissman, M. M., Rounsaville, B. J., & Chevron, E. S. (1984). Interpersonal therapy of depression. New York, NY: Basic Books.
52. Kline, R. (2010). Principles and practice of structural equation modelling (3rd ed.). New York, NY: Guilford.
53. Kuyken, W., Watkins, E., Holden, E., White, K., Taylor, R., Byford, S., ... Dalgleish, T. (2010). How does mindfulness-based cognitive therapy work? Behavior Research and Therapy, 48, 1105-1112.
54. Lappalainen, R., Lehtonen, T., Skarp, E., Taubert, E., Ojanen, M., & Hayes, S. C. (2007). The impact of CBT and ACT models using psychology trainee therapists. Behavior Modification, 31, 488-511.
55. Marsh, H., Muthen, B., Asparouhove, T., Ludtke, O., Robitzsch, A., Morin, A., & Trautwein, U. (2009). Exploratory structural equation modeling, integrating CFA and EFA: Applications to students' evaluations of university teaching. Structural Equation Modeling, 16, 439-476.
56. Marshall, S., Parker, P., Ciarrochi, J., & Heaven, P. (2014). Is self-esteem a cause or consequence of social support? A 4-year longitudinal study. Child Development, 85, 1275-1291.
57. Masuda, A., Hayes, S. C., Fletcher, L. B., Seignourel, P. J., Bunting, K., Herbst, S. A., ... Lillis, J. (2007). Impact of acceptance and commitment therapy versus education on stigma toward people with psychological disorders. Behaviour Research and Therapy, 45, 2764-2722.
58. McKenna, I., Barnes-Holmes, D., Barnes-Holmes, Y., & Stewart, I. (2007). Testing the fakeability of the Implicit Relational Assessment Procedure (IRAP): The first study. International Journal of Psychology and Psychological Testing, 7, 253-268.
59. McNulty, J., & Fincham, F. (2011). Beyond positive psychology? Toward a contextual view of psychological processes and well-being. American Psychologist, 67, 101-110.
60. Meyer, G. J. (1999). Introduction to the special series on the utility of the Rorschach for clinical assessment. Psychological Assessment, 11, 235-239.
61. Miller, A. B., Wall, C., Baines, C. J., Sun, P., To, T., & Narod, S. A. (2014). Twenty-five year follow-up for breast cancer incidence and mortality of the Canadian National Breast Screening Study: Randomised screening trial. British Medical Journal, 348, g366.
62. Millon, T. (2006). Millon Clinical Multiaxial Inventory-III manual. Minneapolis, MN: NCS Pearson.
63. Nelson, R. O., & Hayes, S. C. (1986). The nature of behavioral assessment. In R.O. Nelson & S. C. Hayes (Eds.), Conceptual foundations of behavioral assessment (pp. 3-41). New York, NY: Guilford.
64. Nelson-Gray, R. (2003). Treatment utility of psychological assessment. Psychological Assessment, 15, 521-531.
65. Nezu, A. M., & Nezu, C. M. (2001). Problem solving therapy. Journal of Psychotherapy Integration, 11, 187-205.
66. Nolen-Hoeksema, S., Morrow, J., & Fredrickson, B. L. (1993). Response styles and the duration of depressed mood. Journal of Abnormal Psychology, 102, 20-28.
67. Nunnally, J. (1967). Psychometric therory. New York, NY: McGraw-Hill.
68. O'Neill, R. E., Horner, R. H., Albin, R. W., Story, K., Sprague, J. R. (1990). Functional analysis of problem behavior: A practical assessment guide. Sycamore, IL: Sycamore Publishing.
69. Parling, T., Cernvall, M., Stewart, I., Barnes-Holmes, D., & Ghaderi, A. (2012). Using the Implicit Relational Assessment Procedure to compare implicit pro-thin/anti-fat attitudes of patients with anorexia nervosa and nonclinical controls. Eating Disorders 20, 127-143.
70. Paul, G. L. (1969). Behavior modification research: Design and tactics. In C. M. Franks (Ed.), Behavior therapy: Appraisal and status (pp. 29-62). New York, NY: McGraw-Hill.
71. Regier, D. A., Farmer, M. E., Rae, D. S., Locke, B. Z., Keith, S. J., Judd. L. L., & Goodwin, F. K. (1990). Comorbidity of mental disorders with alcohol and other drug abuse: Results from the Epidemiologic Catchment Area (ECA) Study. Journal of the American Medical Association, 264, 2511-2518.
72. Repp, A. C., Felce, D., & Barton, L. E. (1988). Basing the treatment of stereotypic and selfinjurious behaviors on hypotheses of their causes. Journal of Applied Behavior Analysis, 21, 281-289.
73. Roddy, S., Stewart, I., & Barnes-Holmes, D. (2010). Anti-fat, pro-slim, or both: Using two reaction-time based measures to assess implict attitudes to the slim and overweight. Journal of Health Psychology, 15, 416-425.
74. Ruiz-Padial, E., Sollers, J., Vila, J., & Thayer, J. (2003). The rhythm of the heart in the blink of an eye: Emotion-modulated startle magnitude covaries with heart rate variability. Psychophysiology, 40, 306-313.
75. Sartorius, N., Ustun, T. B, Lecruiber, Y., & Wittchen, H-U. (1996). Depression comorbid with anxiety: Results from the WHO study on "Psychological disorders in primary health care." The British Journal of Psychiatry, 168, 38-43.
76. Segerstrom, S. C., & Nes, L. S. (2007). Heart rate variability reflects self-regulatory strength, effort, and fatigue. Psychological Science, 18, 275-281.
77. Shiffman, S., Stone, A., & Hufford, M. (2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4, 1-32.
78. Sotsky, S. S., Glass, D. R., Shea, T., Pilknois, P. A., Collins, J. F., Elkin, I., ... Oliveri, M, E. (1991). Patient predictors of response to psychotherapy and pharmacotherapy: Findings in the NIMH Treatment of Depression Collaborative Research Program. The American Journal of Psychiatry, 148, 997-1008.
79. Timko, C. A., England, E. L., Herbert, J. D., & Forman, E. (2010). The Implicit Relational Assessment Procedure as a measure of self-esteem. The Psychological Record, 60, 679-698.
80. Viglione, D. J. (1999). A review of recent research addressing the utility of the Rorschach. Psychological Assessment, 11, 251-265.
81. Wilson, K. G., Sandoz, E. K., Kitchens, J., & Roberts, M. (2010). The Valued Living Questionnaire: Defining and measuring valued action within a behavioral framework. The Psychological Record, 60, 249-272.
82. Zettle, R. D. (2003). Acceptance and commitment therapy (ACT) vs. systematic desensitization in treatment of mathematics anxiety. The Psychological Record, 53, 197-215.
83. Zettle, R. D., Haflich, J. L., & Reynolds, R. A. (1992). Responsivity to cognitive therapy as a function of treatment format and client personality dimensions. Journal of Clinical Psychology, 48, 787-797.
84. Zettle, R. D., & Herring, E. L. (1995). Treatment utility of the sociotropy/autonomy distinction:Implications for cognitive therapy. Journal of Clinical Psychology, 51, 280-288.