Focus groups in psychological assessment: Enhancing content validity by consulting members of the target population

Psychological Assessment

Volumn 16, Issue 3, 2004, Pages 231-243

  Vogt, Dawne S ^a,b,c,d   King, Daniel W ^a,b,c   King, Lynda A ^a,b,c  

^a BOSTON UNIVERSITY   (United States)

^b VA BOSTON HEALTHCARE SYSTEM   (United States)

^c BOSTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d Natl Ctr Posttraum Stress Disord   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONSULTATION; HUMAN; INFORMATION PROCESSING; INTELLIGENCE; MEDICAL RESEARCH; PSYCHOLOGIC ASSESSMENT; QUESTIONNAIRE; REVIEW; STRESS; VALIDATION PROCESS;

COMBAT DISORDERS; FOCUS GROUPS; GULF WAR; HUMANS; PATIENT PARTICIPATION; PERSONALITY ASSESSMENT; PSYCHOMETRICS; REFERRAL AND CONSULTATION; REPRODUCIBILITY OF RESULTS; VETERANS;

EID: 4544353196     PISSN: 10403590     EISSN: None     Source Type: Journal    
DOI: 10.1037/1040-3590.16.3.231     Document Type: Review

References (82)

1. Asbury, J. E. (1995). Overview of focus group research. Qualitative Health Research, 5, 414-420.
2. Barbour, R. S., & Kitzinger, J. (1999). Developing focus group research. Thousand Oaks, CA: Sage.
3. Basch, C. E. (1987). Focus group interview: An underutilized research technique for improving theory and practice in health education. Health Education Quarterly, 14, 411-448.
4. Bollen, K., & Lennox, R. (1991). Conventional wisdom on measurement: A structural equations perspective. Psychological Bulletin, 110, 305-314.
5. Breslau, N., & Davis, G. C. (1987). Posttraumatic stress disorder: The etiological specificity of wartime Stressors. American Journal of Psychiatry, 144, 578-583.
6. Byers, P. Y., Zeller, R. A., & Byers, B. D. (2002). Focus group method. In M. W. Wiederman & B. E. Whitley, Jr. (Eds.), Handbook for conducting research on human sexuality (pp. 173-193). Mahwah, NJ: Erlbaum.
7. Calder, B. J. (1977). Focus groups and the nature of qualitative marketing research. Journal of Marketing Research, 14, 353-364.
8. Campbell, D. T. (1960). Recommendations for APA test standards regarding construct, trait, or discriminant validity. American Psychologist, 15, 546-553.
9. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
10. Carey, M. A. (1994). The group effect in focus groups: Planning, implementing and interpreting focus group research. In J. M. Morse (Ed.), Critical issues in qualitative research methods (pp. 225-241). London: Sage.
11. Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309-319.
12. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
13. DeVellis, R. F. (1991). Scale development: Theory and applications. Newbury Park, CA: Sage.
14. Fagot, B. I. (1992). Assessment of coercive parent discipline. Behavioral Assessment, 14, 387-406.
15. Farquhar, C. (1999). Are focus groups suitable for "sensitive" topics? In R. S. Barbour & J. Kitzinger (Eds.), Developing focus group research (pp. 47-63). Thousand Oaks, CA: Sage.
16. Frankland, J., & Bloor, M. (1999). Some issues arising in the systematic analysis of focus group materials. In R. S. Barbour & J. Kitzinger (Eds.), Developing focus group research (pp. 144-155). Thousand Oaks, CA: Sage.
17. Frank-Stromberg, M. (1989). Reaction to the Diagnosis of Cancer Questionnaire: Development and psychometric evaluation. Nursing Research, 38, 364-369.
18. Gallers, J., Foy, D. W., Donahoe, C. P., & Goldfarb, J. (1988). Posttraumatic stress disorder in Vietnam combat veterans: Effects of traumatic violence exposure and military adjustment. Journal of Traumatic Stress, 1, 181-192.
19. Gray-Vickrey, P. (1993). Gerontological research: Use and application of focus groups. Journal of Gerontological Nursing, 19(5), 21-27.
20. Green, B. L. (1994). Psychological research in traumatic stress: An update. Journal of Traumatic Stress, 7, 341-362.
21. Greenbaum, T. L. (1998). The handbook for focus group research (2nd ed.). Thousand Oaks, CA: Sage.
22. Haynes, S. N., & Lench, H. C. (2003). Incremental validity of new clinical assessment measures. Psychological Assessment, 15, 456-466.
23. Haynes, S. N., Nelson, K., & Blaine, D. D. (1999). Psychometric issues in assessment research. In P. C. Kendall & J. N. Butcher (Eds.), Handbook of research methods in clinical psychology (2nd ed., pp. 125-154). New York: Wiley.
24. Haynes, S. N., & O'Brien, W. H. (2000). Specificity of variables. In S. N. Haynes & W. H. O'Brien (Eds.), Principles and practice of behavioral assessment (pp. 128-139). Norwell, MA: Kluwer Academic/Plenum Publishers.
25. Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238-247.
26. Hendin, H., & Haas, A. P. (1984). Combat adaptations of Vietnam veterans without posttraumatic stress disorders. American Journal of Psychiatry, 141, 956-959.
27. Hunsley, J. (2003). Introduction to the special section on incremental validity and utility in clinical assessment. Psychological Assessment, 15, 443-445.
28. Jackson. D. N. (1971). The dynamics of structured personality tests: 1971. Psychological Review, 78, 229-248.
29. Kaylor, J., King, D. W., & King, L. A. (1987). Psychological effects of military service in Vietnam: A meta-analysis. Psychological Bulletin, 102, 257-271.
30. Keane, T. M., Fairbank, J. A., Caddell, J. M., Zimering, R. T., Taylor, K. L., & Mora, C. A. (1989). Clinical evaluation of a measure to assess combat exposure. Psychological Assessment, 1, 53-55.
31. King, D. W., & King, L. A. (1991). Validity issues in research on Vietnam veteran adjustment. Psychological Bulletin, 109, 107-124.
32. King, D. W., King, L. A., Gudanowski, D. M., & Vreven, D. L. (1995). Alternative representations of war zone Stressors: Relationships to posttraumatic stress disorder in male and female Vietnam veterans. Journal of Abnormal Psychology, 104, 184-196.
33. King, D. W., King, L. A., & Vogt, D. S. (2003). Manual for the Deployment Risk and Resilience Inventory (DRRI): A collection of measures for studying deployment-related experiences in military veterans. Boston: National Center for PTSD.
34. King, L. A., & King, D. W. (1990). Role conflict and role ambiguity: A critical assessment of construct validity. Psychological Bulletin, 107, 48-64.
35. King, L. A., King, D. W., Vogt, D. S., Knight, J. A., & Samper, R. E. (2004). Development and psychometric properties of the Deployment Risk and Resilience Inventory. Manuscript submitted for publication.
36. Krueger, R. A. (1994). Focus groups: A practical guide for applied research (2nd ed.). Beverly Hills, CA: Sage.
37. Krueger, R. A. (1998a). Moderating focus groups. Thousand Oaks, CA: Sage.
38. Krueger, R. A. (1998b). Analyzing and reporting focus group results. Thousand Oaks, CA: Sage.
39. Kubany, E. S., Abueg, F. R., Kilauano, W. L., Manke, F. P., & Kaplan, A. S. (1997). Development and validation of the sources of Trauma-Related Guilt Survey-War-Zone version. Journal of Traumatic Stress, 10, 235-258.
40. Kubany, E. S., Haynes, S. N., Abueg, F. R., Manke, F. P., Brennan, J. M., & Stahura, C. (1996). Development and validation of the Trauma-Related Guilt Inventory (TRGI). Psychological Assessment, 8, 428-444.
41. Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 635-694.
42. Loo, C. M., Fairbank, J. A., Scurfieldl, R. M., Ruch, L. O., King, D. W., Adams, L. J., & Chemtob, C. M. (2001). Measuring exposure to racism: Development and validation of a Race-Related Stressor Scale (RRSS) for Asian American Vietnam veterans. Psychological Assessment, 13, 503-520.
43. Lynn, M. R. (1985). Reliability estimates: Use and disuse. Nursing Research, 34, 254-256.
44. Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35, 382-385.
45. MacCallum, R. C., & Browne, M. W. (1993). The use of causal indicators in covariance structure models: Some practical issues. Psychological Bulletin, 114, 533-541.
46. Malgady, R. G., Rogler, L. H., & Cortes, D. E. (1996). Cultural expression of psychiatric symptoms: Idioms of anger among Puerto Ricans. Psychological Assessment, 3, 265-268.
47. Marsella, A. J., & Kameoka, V. A. (1989). Ethnocultural issues in the assessment of psychopathology. In S. Wetzler (Ed.), Measuring mental illness: Psychometric assessment for clinicians (pp. 231-256). Washington, DC: American Psychiatric Association.
48. Marshall, G. N., Davis, L. M., & Sherbourne, C. D. (1999). A review of the scientific literature as it pertains to Gulf War illnesses: Vol. 4: Stress. Arlington, VA: RAND.
49. Messick, S. (1975). The standard problem: Meaning and values in measurement and evaluation. American Psychologist, 30, 955-966.
50. Messick, S. (1995). Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice, 14, 5-8.
51. Michell, L. (1999). Combining focus groups and interviews: Telling how it is; telling how it feels. In R. S. Harbour & J. Kitzinger (Eds.), Developing focus group research (pp. 36-46). Thousand Oaks, CA: Sage.
52. Millward, L. J. (2000). Focus groups. In G. M. Breakwell, S. Hammond, & C. Fife-Schaw (Eds.), Research methods in psychology (2nd ed., pp. 303-324). London: Sage.
53. Mitchell, J. V., Jr. (1986). Measurement in the larger context: Critical current issues. Professional Psychology: Research and Practice, 17, 544-550.
54. Morgan, D. L. (1988). Focus groups as qualitative research. Newbury Park, CA: Sage.
55. Morgan, D. L. (1996). Focus groups. Annual Review of Sociology, 22, 129-152.
56. Morgan, D. L. (1997). Focus groups as qualitative research (2nd ed.). Thousand Oaks, CA: Sage.
57. Netland, M. (2001). Assessment of exposure to political violence and other potentially traumatizing events: A critical review. Journal of Traumatic Stress, 14, 311-326.
58. Norwood, A. E., & Ursano, R. J. (1996). The Gulf War. In R. J. Ursano & A. E. Norwood (Eds.), Emotional aftermath of the Persian Gulf War: Veterans, families, communities, and nations (pp. 3-21). Washington, DC: American Psychiatric Association.
59. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. New York: McGraw-Hill.
60. O'Brien, K. (1993a). Improving Survey Questionnaires through focus groups. In D. L. Morgan (Ed.), Successful focus groups: Advancing the state of the art (pp. 105-117). Thousand Oaks, CA: Sage.
61. O'Brien, K. (1993b). Using focus groups to develop health surveys: An example from research on social relationships and AIDS-'preventive behavior. Health Education Quarterly, 20, 361-372.
62. Ozer, E. J., Best, S. R., Lipsey, T. L., & Weiss, D. S. (2003). Predictors of posttraumatic stress disorder and symptoms in adults: A meta-analysis. Psychological Bulletin, 129, 52-73.
63. Paul, E. A. (1985). Wounded healers: A summary of the Vietnam Nurse Veteran Project. Military Medicine, 150, 571-576.
64. Pelto, P. J. (1970). Anthropological research: The structure of inquiry. New York: Harper & Row.
65. Pike, K. (1954). Language in relation to a unified theory of the structure of human behavior (Vol. 1). Glendale, CA: Summer Institute of Linguistics.
66. Podolefsky, A., & Brown, P. J. (1999). Applying anthropology (5th ed.). Mountain View, CA: Mayfield Publishing.
67. Powell, R. A., Single, H. M., & Lloyd, K. R. (1996). Focus groups in mental health research: Enhancing the validity of user and provider questionnaires. International Journal of Social Psychiatry, 42, 193-206.
68. Reckase, M. D. (1996). Test construction in the 1990s: Recent approaches every psychologist should know. Psychological Assessment, 8, 354-359.
69. Resnick, H. S., Kilpatrick, D. G., & Lipovsky, J. A. (1991). Assessment of rape-related posttraumatic stress disorder: Stressor and symptom dimensions. Psychological Assessment, 3, 561-572.
70. Schwab, D. P. (1980). Construct validity in organizational behavior. Research in Organizational Behavior, 2, 3-43.
71. Sechrest, L. (1963). Incremental validity: A recommendation. Educational and Psychological Measurement, 23, 153-158.
72. Smith, G. T., & McCarthy, D. M. (1995). Methodological considerations in the refinement of clinical assessment instruments. Psychological Assessment, 7, 300-308.
73. Soclari. (2003a). The Ethnograph (Version 5.0 for Windows) [Computer software]. London: Sage.
74. Soclari. (2003b). QSR N6. [Computer software]. London: Sage.
75. Solomon, Z., Mikulincer, M., & Hobfoll, S. E. (1987). Objective versus subjective measurement of stress and social support: Combat-related reactions. Journal of Consulting and Clinical Psychology, 55, 577-583.
76. Spencer, L., Faulkner, A., & Keegan, J. (1988). Talking about sex. London: Social and Community Planning Outreach.
77. Stretch, R. H., Vail, J. D., & Maloney, J. P. (1985). Incidence and etiology of posttraumatic stress disorder among Army Nurse Corps Vietnam veterans. Journal of Consulting and Clinical Psychology, 53, 935-936.
78. Suen, H. K. (1990). Principles of test theories. Hillsdale, NJ: Erlbaum.
79. Switzer, G. E., Wisniewski, S. R., Belle, S. H., Dew, M. A., & Schultz, R. (1999). Selecting, developing, and evaluating research instruments. Social Psychiatry Psychiatric Epidemiology, 34, 399-409.
80. Tilden, V. P., Nelson, C. A., & May, B. A. (1990). Use of qualitative methods to enhance content validity. Nursing Research, 39, 172-175.
81. Van Gerwen, L. J., Spinhoven, P., Van Dyck, R., & Diekstra, R. F. W. (1999). Construction and psychometric characteristics of two self-report questionnaires for the assessment of fear of flying. Psychological Assessment, 11, 146-158.
82. Yates, B. T., & Taub, J. (2003). Assessing the costs, benefits, cost-effectiveness, and cost-benefit of psychological assessment: We should, we can, and here's how. Psychological Assessment, 15, 478-495.