A generalizability approach to assessing the effects of ethnicity and training on observer ratings of family interactions

Journal of Social and Personal Relationships

Volumn 20, Issue 2, 2003, Pages 171-191

  Melby, Janet N ^a,c   Hoyt, William T ^b   Bryant, Chalandra M ^a  

^a IOWA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

^c Instit Social and Behavioral Research   (United States)

Author keywords

Ethnicity; Family interaction; Rater bias

Indexed keywords

EID: 0037274303     PISSN: 02654075     EISSN: None     Source Type: Journal    
DOI: 10.1177/0265407503020002003     Document Type: Article

References (52)

1. Albright, L., Malloy, T. E., Dong, Q., Kenny, D. A., Fang, X., Winqist, L., & Yu, D. (1997). Cross-cultural consensus in personality judgments. Journal of Personality and Social Psychology, 71, 558-569.
2. Alexander, J. F., Newell, R. M., Robbins, M. S., & Turner, C. W. (1995). Observational coding in family therapy process research. Journal of Family Psychology, 9, 355-365.
3. Archer, D. (1997). Unspoken diversity: Cultural differences in gestures. Qualitative Sociology, 20, 79-105.
4. Bailey, W., Nowicki, S., Jr., & Cole, S. P. (1998). The ability to decode nonverbal information in African American, African, and Afro-Caribbean, and European American adults. Journal of Black Psychology, 24, 418-431.
5. Bennion, L. D. (1993, March). A heuristic model for examining factors that affect the concordance of observers. In J. Dyer & J. Gentil (Chairs), Statistical approaches. Symposium conducted at the meeting of the Society for Research in Child Development, New Orleans, LA.
6. Biernat, M., & Manis, M. (1994). Shifting standards and stereotype-based judgments. Journal of Personality and Social Psychology, 66, 5-20.
7. Brennan, R. L. (1992). Elements of generalizability theory (2nd ed.). Iowa City, IA: ACT.
8. Bryant, C.M. (1996). Subcultural variations in the social network support of Latinos, African Americans, and Anglos: What is the association between the development of heterosexual relationships and the support of friends and family members? Unpublished doctoral dissertation, University of Texas at Austin.
9. Carver, C. S., Glass, D. C., & Katz, I. (1978). Favorable evaluations of blacks and the handicapped: Positive prejudice, unconscious denial, or social desirability? Journal of Applied Social Psychology, 6, 97-106.
10. Colvin, C. R. (1993). Childhood antecedents of young-adult judgability. Journal of Personality, 61, 611-631.
11. Conger, R. D., Gibbons, F., Cutrona, C., & Simons, R. (1995). Center for Family Research in Rural Mental Health. National Institute on Mental Health, Grant #MH48165 (Sept. 1, 1995 - Aug. 31, 2000).
12. Costigan, C. L., Bardina, P. & Cauce, A. M. (1998, February). Potential biases in observational research with Asian-American families. In A. M. Cauce (Chair), Issues in multi-cultural/multi-ethnic observational research. Symposium conducted at the seventh biennial meeting of the Society for Research on Adolescence, San Diego, CA.
13. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
14. Delgado, B. M., & Ford, L. (1998). Parental perceptions of child development among low-income Mexican American families. Journal of Child and Family Studies, 7, 469-481.
15. Devine. P. G. (1989). Stereotypes and prejudice: Their automatic and controlled components. Journal of Personality and Social Psychology, 56, 5-18.
16. Ekman, P., & Friesen, W. V. (1975). Unmasking the face: A guide to recognizing emotions from facial expressions. Englewood Cliffs, NJ: Prentice-Hall.
17. Forgatch, M. (1998, February). Critical issues in multi-cultural/multi-ethnic observational research. In A. M. Cauce (Chair), Issues in multi-cultural/multi-ethnic observational research. Symposium conducted at the seventh biennial meeting of the Society for Research on Adolescence, San Diego, CA.
18. Foster, S. L., & Martinez, C. R., Jr. (1995). Ethnicity: Conceptual and methodological issues in clinical child psychology research. Journal of Clinical Child Psychology, 24, 214-226.
19. Gonzales, N., Cauce, A., & Mason, C. (1996). Interobserver agreement in the assessment of parental behavior and parent-adolescent conflict: African American mothers, daughters, and independent observers. Child Development, 67, 1483-1498.
20. Harber, K. D. (1998). Feedback to minorities: Evidence of a positive bias. Journal of Personality and Social Psychology, 74, 622-628.
21. Hayden, L. C., Schiller, M., Sameroff, A. J., Miller, I., Keitner, G., & Rasmussen, S. (1998). Levels of family assessment: Family, marital, and parent-child interactions. Journal of Family Psychology, 12, 7-22.
22. Hines, A. M. (1993). Linking qualitative and quantitative methods in cross-cultural survey research: Techniques from cognitive science. American Journal of Community Psychology, 21, 729-746.
23. Hoyt, W. T. (2000). Rater bias in psychological research: When is it a problem and what can we do about it? Psychological Methods, 5, 64-86.
24. Hoyt, W. T., & Kerns, M. D. (1999). Magnitude and moderators of bias in observer ratings: A meta-analysis. Psychological Methods, 4, 403-424.
25. Hoyt, W. T., & Melby, J. N. (1999). Dependability of measurement in counseling psychology: An introduction to generalizability theory. The Counseling Psychologist, 27, 325-352.
26. Izard, C. E. (1994). Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin, 115, 288-299.
27. Kenny, D. A. (1994). Interpersonal perception: A social relations analysis. New York: Guilford Press.
28. Kraiger, K., & Ford, J. K. (1985). A meta-analysis of ratee ethnic group effects in performance ratings. Journal of Applied Psychology, 70, 56-65.
29. Leong, F. T. L. (1997). Cross-cultural career psychology. Journal of Counseling Psychology, 44, 355-359.
30. Lewis-Fernandez, R., & Kleinman, A. (1994). Culture, personality, and psychopathology. Journal of Abnormal Psychology, 103, 67-71.
31. Lorenz, F. O., & Melby, J. N. (1994). Analyzing family stress and adaptation: Methods of study. In R. D. Conger & G. H. Elder (Eds.), Families in troubled times: Adapting to change in rural America (pp. 21-54). Hawthorne, NY: Aldine de Gruyter.
32. Markman, H. J., Leber, B. C., Cordova, A. D., & St. Peters, M. (1995). Behavioral observation and family psychology - strange bedfellows or happy marriage? Comment on Alexander et al. (1995). Journal of Family Psychology, 9, 371-379.
33. Martin, L. L., Seta, J. J., & Crelia, R. A. (1990). Assimilation and contrast as a function of people's willingness and ability to expend effort in forming an impression. Journal of Personality and Social Psychology, 59, 27-37.
34. Matsumoto, D. (1989). Cultural influences on the perception of emotion. Journal of Cross Cultural Psychology, 20, 92-105.
35. McMains, J. (1996, Spring). The video archive. The Henry A. Murray Research Center Newsletter. Radcliffe College, Cambridge, MA, p. 1.
36. Melby, J. N., & Conger, R. D. (2001). The Iowa Family Interaction Rating Scales: Instrument summary. In P. Kerig & K. Lindahl (Eds.), Family observational coding systems: Resources for systematic research (pp. 33-58). Mahwah, NJ: Erlbaum.
37. Melby, J. N., Conger, R. D., Book, R., Rueter, M., Lucy, L., Repinski, D., Ahrens, K., Black, D., Brown, D., Huck, S., Mutchler, L., Rogers, S., Ross, J., & Stavros, T. (1993). The Iowa Family Interaction Rating Scales (4th ed.). Unpublished manuscript. Institute for Social and Behavioral Research, Iowa State University, Ames.
38. Melby, J. N., Ge, X., Conger, R. D., & Warner, T. D. (1995). The importance of task in evaluating positive marital interactions. Journal of Marriage and the Family, 57, 981-994.
39. Nowicki, S., Jr., Glanville, D., & Demertzis, A. (1998). A test of the ability to recognize emotion in the facial expression of African American adults. Journal of Black Psychology, 24, 335-350.
40. Okazaki, S., & Sue, S. (1995). Methodological issues in assessment research with ethnic minorities. Psychological Assessment, 7, 367-375.
41. Parke, R. D. (1998). Editorial. Journal of Family Psychology, 12, 3-6.
42. Patterson, G. R., & Reid, J. B. (1984). Social interactional processes within the family: The study of the moment-by-moment family transactions in which human social development is imbedded. Journal of Applied Developmental Psychology, 5, 237-262.
43. Phelps, R. E., Meara, N. M., Davis, K. L., & Patton, M. J. (1991). Blacks' and whites' perceptions of verbal aggression. Journal of Counseling and Development, 69, 345-350.
44. Romero, A. J., Cuéllar, I., & Roberts, R. E. (2000). Ethnocultural variables and attitudes toward cultural socialization of children. Journal of Community Psychology, 28, 79-89.
45. Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115, 102-141.
46. Shrout, P. E. (1993). Analyzing consensus in personality judgments: A variance components approach. Journal of Personality, 61, 769-788.
47. Shrout, P. E. (1995). Measuring the degree of consensus in personality judgments. In P. E. Shrout & S. T. Fiske (Eds.), Personality research, methods, and theory: A Festschrift honoring Donald W. Fiske (pp. 79-92). Hillsdale, NJ: Erlbaum.
48. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 233-244.
49. Smith, P. (1978). Sampling errors of variance components in small sample multifacet generalizability studies. Journal of Educational Measurement, 3, 319-346.
50. Spoth, R. L. (1996). Rural Family and Community Drug Abuse Prevention Project. National Institute on Drug Abuse, Grant #DA07029-01-A1 (Aug. 20, 1996 - July 31, 1999).
51. Tracy, E., & Whittaker, J. (1993). The social network map: Assessing social support in clinical practice. In J. Rauch (Ed.), Assessment: A sourcebook for social work practice (pp. 295-308). Milwaukee: Families International.
52. Wegener, D. T., & Petty, R. E. (1997). The flexible correction model: The role of naive theories of bias in bias correction. In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 29, pp. 141-208). Orlando, FL: Academic Press.