The influence of sociodemographic characteristics on agreement between self-reports and expert exposure assessments

American Journal of Industrial Medicine

Volumn 53, Issue 10, 2010, Pages 1019-1031

  Sembajwe, Grace ^a,b,c   Quinn, Margaret ^a   Kriebel, David ^a   Stoddard, Anne ^d   Krieger, Nancy ^b   Barbeau, Elizabeth ^b,c  

^a UNIVERSITY OF MASSACHUSETTS LOWELL   (United States)

^b HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

^c DANA FARBER CANCER INSTITUTE   (United States)

^d NEW ENGLAND RESEARCH INSTITUTES   (United States)

Author keywords

Agreement; Discord.; Exposure assessment; Higher estimation; Job exposure matrix; Lower estimation; Occupational epidemiology

Indexed keywords

ARTICLE; FEMALE; HUMAN; INDUSTRY; INFORMATION PROCESSING; MALE; MIDDLE AGED; OBSERVER VARIATION; OCCUPATION; OCCUPATIONAL EXPOSURE; OCCUPATIONAL HEALTH; REPRODUCIBILITY; SELF REPORT; SOCIOECONOMICS; STATISTICAL MODEL; STATISTICS; WORKPLACE;

DATA COLLECTION; FEMALE; HUMANS; INDUSTRY; MALE; MIDDLE AGED; MODELS, STATISTICAL; OBSERVER VARIATION; OCCUPATIONAL EXPOSURE; OCCUPATIONAL HEALTH; OCCUPATIONS; REPRODUCIBILITY OF RESULTS; SELF REPORT; SOCIOECONOMIC FACTORS; WORKPLACE;

EID: 77956949007     PISSN: 02713586     EISSN: 10970274     Source Type: Journal    
DOI: 10.1002/ajim.20821     Document Type: Article

References (60)

1. Agresti A. 1988. A model for agreement between ratings on an ordinal scale. Biometrics 44(2):539-548.
2. Badger D. 1981. Work practices guide for manual lifting: U.S. Department of Health and Human Services. Cincinnati, Ohio: National Institute for Occupational Safety and Health, Publication No. 81-122.
3. Barbeau EM, Hartman C, Quinn MM, Stoddard AM, Krieger N. 2007. Methods for recruiting white, black, and hispanic workingclass women and men to a study of physical and social hazards at work: The united for health study. Int J Health Serv 37(1):127-144.
4. Bauer E, Romitti P, Reynolds S. 1999. Evaluation of reports of periconceptual occupational exposure: Maternal-assessed versus industrial hygienist-assessed exposure. Am J Ind Med 36(5):573-578.
5. Benke G, Sim M, Forbes A, Salzberg M. 1997. Retrospective assessment of occupational exposure to chemicals in community-based studies:Validity and repeatability of industrial hygiene panel ratings. Int J Epidemiol 26(3):635-642.
6. Benke G, Sim M, Fritschi L, Aldred G, Forbes A, Kauppinen T. 2001. Comparison of occupational exposure using three different methods: Hygiene panel, job exposure matrix (JEM), and self reports. Appl Occup Environ Hyg 16(1):84-91.
7. Buettner P, Garbe C. 2000. Agreement between self-assessment of melanocytic nevi by patients and dermatologic examination. Am J Epidemiol 151(1):72-77.
8. Calvert G, Mueller C, O'Neill V, Fajen J, Briggle T, Fleming L. 1997. Agreement between company recorded self-reported estimates of duration and frequency to occupational fumigant exposure. Am J Ind Med 32(4):364-368.
9. Carlin J, Ryan L, Harvey E, Holmes L. 2000. Anticonvulsant teratogenesis 4: Inter-rater agreement in assessing minor physical features related to anticonvulsant therapy. Teratology 62(6):406-412.
10. Cicchetti D, Feinstein A. 1990. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol 43(6):551-558. (Pubitemid 20178544)
11. Cohen J. 1960. A coefficient of agreement for nominal scales. Educ Psychol Meas 20:37-46.
12. D'Souza JC, Keyserling WM, Werner RA, Gillespie B, Franzblau A. 2007. Expert consensus ratings of job categories from the third national health and nutrition examination survey (NHANES III). Am J Ind Med 50(8):608-616.
13. Feinstein A, Cicchetti D. 1990. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43(6):543-549. (Pubitemid 20178543)
14. Fienberg S. 1980. The analysis of cross-classified data. Cambridge,MA: The MIT Press.
15. Fleiss JL. 1981. Statistical methods for rates and proportions, 2nd edition. New York: John Wiley and Sons. p 216, 218.
16. Fritschi L, Siemiatycki J, Richardson L. 1996. Self-assessed versus expert-assessed occupational exposures. Am J Epidemiol 144(5):521-527.
17. Goodman L. 1979. Simple models for the analysis of association in cross-classifications having ordered categories. J Am Stat Assoc 74:537-552.
18. Graham P, Jackson R. 2000. A comparison of primary and proxy respondent reports of habitual physical activity, using kappa statistics and log-linear models. J Epidemiol Biostat 5(4):255-265.
19. Groves R. 1989. Survey errors and survey costs. New York, NY: John Wiley & Sons.
20. Hammond S, Hines C, Hallock M, Hallock M, Woskie S, Abdollahzadeh S, Iden C, Anson E, Ramsey F, Schenker M. 1995. Tiered exposureassessment strategy in the semiconductor health study. Am J Ind Med 28(6):661-680.
21. Hawkins N, Evans J. 1989. Subjective estimation of toluene exposures: A calibration study of industrial hygienists. Appl Ind Hyg J 4:61-68.
22. Hertzman C, Teschke K, Dimich-Ward H, Ostry A. 1988. Validity and reliability of a method for retrospective evaluation of chlorophenate exposure in the lumber industry. Am J Ind Med 14(6): 703-713.
23. Hu Y, Smith T, Xu X, Wang L, Watanabe H, Christiani D. 2002. Comparison of self-assessment of solvent exposure with measurement and professional assessment for female petrochemical workers in china. Am J Ind Med 41(6):483-489.
24. Hunt P. 2006. Loglinear modeling of agreement. Doctoral Dissertation: University of Massachusetts, Lowell.
25. Karasek R. 1985. Job content questionnaire and user's guide. Lowell: University of Massachusetts.
26. Kennedy SM, Koehoorn M. 2003. Exposure assessment in epidemiology: Does gender matter? Am J Ind Med 44(6):576-583.
27. Kleinbaum D, Kupper L, Muller K, Nizam A. 1998. Applied regression analysis and other multivariable methods. Pacific Grove, CA: Duxbury Press.
28. Kleinman G, Horstman S, Kalman D, McKenzie J, Stansel D. 1986. Industrial hygiene, chemical and biological assessment of exposures to a chlorinated phenolic sapstain control agent. Am Ind Hyg Assoc J 47(12):731-741.
29. Krieger N. 1994. Epidemiology and the web of causation: Has anyone seen the spider? Soc Sci Med 39(7):887-903.
30. Krieger N. 2001. Theories for social epidemiology in the 21st century: An ecosocial perspective. Int J Epidemiol 30(4):668-677.
31. Krieger N, Smith K, Naishadham D, Hartman C, Barbeau EM. 2005. Experiences of discrimination: Validity and reliability of a self-report measure for population health research on racism and health. Soc Sci Med 61(7):1576-1596.
32. Krieger N,Waterman PD, Hartman C, Bates LM, Stoddard AM, Quinn MM, Sorensen G, Barbeau EM. 2006. Social hazards on the job: Workplace abuse, sexual harassment, and racial discrimination-A study of Black, Latino, and White low-income women and men workers in the United States. Int J Health Sci 36(1):51-85.
33. Kromhout H, Oostendorp Y, Heederik D, Boleij J. 1987. Agreement between qualitative exposure estimates and quantitative exposure measurements. Am J Ind Med 12(5):551-562.
34. Lester Kirchner H, Lemke J. 2002. Simultaneous estimation of intrarater and interrater agreement for multiple raters under order restrictions for a binary trait. Stat Med 21(12):1761-1772.
35. Maclure M,WillettW. 1987. Misinterpretation and misuse of the kappa statistic. Am J Epidemiol 126(2):161-169.
36. Monge P, Partanen T,Wesseling C, BravoV, Ruepert C, Burstyn I. 2005. Assessment of pesticide exposure in the agricultural population of Costa Rica. Ann Occup Hyg 49(5):375-384.
37. Nelson J, Pepe M. 2000. Statistical description of interrater variability in ordinal ratings. Stat Methods Med Res 9(5):475-496.
38. Nieuwenhuijsen M. 2005. Design of exposure questionnaires for epidemiological studies. Occup Eviron Med 62(4):272-280.
39. Owen C, Acquavella J, Lynch J, Bird M. 1992. An industrial hygiene methodology developed in support of a retrospective morbidity casecontrol study. Am Ind Hyg Assoc J 53(9):540-547.
40. Perry M, Marbella A, Layde P. 2006. Nonpersistent pesticide exposure self-report versus biomonitoring in farm pesticide applicators. Ann Epidemiol 16(9):701-707.
41. Posner K, Sampson P, Caplan R, Ward R, Cheney F. 1990. Measuring interrater reliability among multiple raters: An example of methods for nominal data. Stat Med 9(9):1103-1115.
42. Quinn MM, Smith TJ, Youk AO, Marsh GM, Stone RA, Buchanich JM, Gula MJ. 2001. Historical cohort study of us man-made vitreous fiber production workers: viii. Exposure-specific job analysis. J Occup Environ Med 43(9):824-834.
43. Quinn M, Sembajwe G, Stoddard A, Kriebel D, Krieger N, Sorensen G, Hartman C, Naishadham D, Barbeau E. 2007. Social disparities in the burden of occupational exposures: Results of a cross-sectional study. Am J Ind Med 50(12):861-875.
44. Schuster C. 2002. A mixture model approach to indexing rater agreement. Br J Math Stat Psychol 55(Pt 2):289-303.
45. Sembajwe G. 2007. Common variable bias in occupational epidemiology. Doctoral Dissertation: University of Massachusetts, Lowell.
46. Siemiatycki J. 1996. Exposure assessment in community-based studies of occupational cancer. Occup Hyg 3:41-58.
47. Siemiatycki J, Fritschi L, Nadon L, Gérin M. 1997. Reliability of an expert rating procedure for retrospective assessment of occupational exposures in community-based case-control studies. Am J Ind Med 31(3):280-286.
48. Stegmann J, Lucking A. 2007. Assessing reliability on annotations (1): Theoretical considerations. Collaborative research center.
49. Technical report. Bielfield, Germany: University of Bielfield. Accessed July 2007.
50. Stewart P, Stewart W. 1994a. Occupational case-control studies: II. Recommendations for exposure assessment. Am J Ind Med 26(3):313-326. (Pubitemid 24271022)
51. Stewart W, Stewart P. 1994b. Occupational case-control studies: I. Collecting information on work histories and work-related exposures. Am J Ind Med 26(3):297-312.
52. Stewart P, Carel R, Schairer C, Blair A. 2000. Comparison of industrial hygienists' exposure evaluations for an epidemiologic study. Scand J Work Environ Health 26(1):44-51.
53. Teschke K, Hertzman C, Dimich-Ward H, Ostry A, Blair J, Hershler R. 1989. A comparison of exposure estimates by worker raters and industrial hygienists. Scand J Work Environ Health 15(6):424-429.
54. Teschke K, Smith J, Olshan A. 2000. Evidence of recall bias in volunteered vs. prompted responses about occupational exposures. Am J Ind Med 38(4):385-388.
55. Tielemans E, Heederik D, Burdorf A, Vermeulen R, Veulemans H, Kromhout H, Hartog K. 1999. Assessment of occupational exposures in a general population: Comparison of different methods. Occup Environ Med 56(3):145-151.
56. Washington State. 2000. Ergonomic rule (wac 296-62-05174). Appendix B of the Washington State Department of Labor and Industries (L&I). Seattle, Washington: Washington Department of Labor and Industries.
57. Waters T, Putz-Anderson V, Garg A. 1994. Applications manual for the revised NIOSH lifting equation,Vol. 94-110 NIOSH CDC. Atlanta, GA: Centers for Disease Control & Prevention (NIOSH).
58. World Health Organization. 2001. Occupational and community noise. Geneva, Switzerland: World Health Organization.
59. Wiktorin C, Hjelm E, Winkel J, Köster M. 1996. Reproducibility of a questionnaire for assessment of physical load during work and leisure time. Stockholm music in study group. Musculoskeletal intervention center. J Occup Environ Med 38(2):190-201.
60. Yoder P, Bruce P, Tapp J. 2001. Comparing sequential associations within a single dyad. Behav Res Methods Instrum Comput 33(3):331-338.