Response bias, weighting adjustments, and design effects in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS)

International Journal of Methods in Psychiatric Research

Volumn 22, Issue 4, 2013, Pages 288-302

  Kessler, Ronald C ^a   Heeringa, Steven G ^b   Colpe, Lisa J ^c   Fullerton, Carol S ^d   Gebler, Nancy ^b   Hwang, Irving ^a   Naifeh, James A ^d   Nock, Matthew K ^e   Sampson, Nancy A ^a   Schoenbaum, Michael ^c   Zaslavsky, Alan M ^a   Stein, Murray B ^f,g   Ursano, Robert J ^d  

^a HARVARD MEDICAL SCHOOL   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

^c NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^d UNIFORMED SERVICES UNIVERSITY OF THE HEALTH SCIENCES   (United States)

^e HARVARD UNIVERSITY   (United States)

^f UNIVERSITY OF CALIFORNIA   (United States)

^g VA SAN DIEGO HEALTHCARE SYSTEM   (United States)

Author keywords

Design effects; Epidemiologic research design; Mental disorders; Sample bias; Sample weights; Suicide; Survey design efficiency; Survey sampling; US Army

Indexed keywords

ADOLESCENT; ADULT; ARMY; ARTICLE; COPING BEHAVIOR; DESIGN EFFECTS; EPIDEMIOLOGY; FEMALE; HEALTH SURVEY; HUMAN; MALE; MENTAL DISEASE; POSTTRAUMATIC STRESS DISORDER; PSYCHOLOGICAL ASPECT; RISK ASSESSMENT; SAMPLE WEIGHTS; SAMPLING BIAS; SOLDIER; STATISTICAL BIAS; STATISTICS; SUICIDE; SURVEY DESIGN EFFICIENCY; SURVEY SAMPLING; TIME; UNITED STATES; YOUNG ADULT;

DESIGN EFFECTS; EPIDEMIOLOGIC RESEARCH DESIGN; MENTAL DISORDERS; SAMPLE BIAS; SAMPLE WEIGHTS; SUICIDE; SURVEY DESIGN EFFICIENCY; SURVEY SAMPLING; US ARMY;

ADOLESCENT; ADULT; BIAS (EPIDEMIOLOGY); EPIDEMIOLOGIC RESEARCH DESIGN; FEMALE; HEALTH SURVEYS; HUMANS; MALE; MENTAL DISORDERS; MILITARY PERSONNEL; RESILIENCE, PSYCHOLOGICAL; RISK ASSESSMENT; STRESS DISORDERS, POST-TRAUMATIC; SUICIDE; TIME FACTORS; UNITED STATES; YOUNG ADULT;

EID: 84889647666     PISSN: 10498931     EISSN: 15570657     Source Type: Journal    
DOI: 10.1002/mpr.1399     Document Type: Article

References (29)

1. Begin G., Boivin M., Bellerose J. (1979) Sensitive data collection through the random response technique: some improvements. Journal of Psychology, 101(1), 53-65.
2. Bliese P.D., Thomas J.L., McGurk D., McBride S., Castro C.A. (2011) Mental health advisory teams: a proactive examination of mental health during combat deployments. International Review of Psychiatry, 23(2), 127-134, DOI: 10.3109/09540261.2011.558834.
3. Bray R.M., Hourani L.L., Olmsted K.L.R., Witt M., Brown J.M., Pemberton M.R., Marsden M.E., Marriott B., Scheffler S., Vandermaas-Peeler R., Weimer B., Calvin S., Bradshaw M., Close K., Hayden D. (2006) 2005 Department of Defense Survey of Health Related Behaviors Among Active Duty Military Personnel: A Component of the Defense Lifestyle Assessment Program (DLAP), Research Triangle Park, NC, Research Triangle Institute.
4. Brink T.L. (1995) Sexual behavior and telling the truth on questionnaires. Psychological Reports, 76(1), 218.
5. Campbell M.J., Waters W.E. (1990) Does anonymity increase response rate in postal questionnaire surveys about sensitive subjects? A randomised trial. Journal of Epidemiology and Community Health, 44(1), 75-76.
6. Couper M.P., Singer E., Conrad F.G., Groves R.M. (2008) Risk of disclosure, perceptions of risk, and concerns about privacy and confidentiality as factors in survey participation. Journal of Official Statistics, 24(2), 255-275.
7. Couper M.P., Singer E., Conrad F.G., Groves R.M. (2010) Experimental studies of disclosure risk, disclosure harm, topic sensitivity, and survey participation. Journal of Official Statistics, 26(2), 287-300.
8. Edwards P.J., Roberts I., Clarke M.J., Diguiseppi C., Wentz R., Kwan I., Cooper R., Felix L.M., Pratap S. (2009) Methods to increase response to postal and electronic questionnaires. Cochrane Database of Systematic Reviews, 8(3), MR000008, DOI: 10.1002/14651858.MR000008.pub4.
9. Fidler D.S., Kleinknecht R.E. (1977) Random responding versus direct questioning: two data-collection methods for sensitive information. Psychological Bulletin, 84(5), 1045-1049.
10. Gadermann A.M., Engel C.C., Naifeh J.A., Nock M.K., Petukhova M., Santiago P.N., Wu B., Zaslavsky A.M., Kessler R.C. (2012) Prevalence of DSM-IV major depression among U.S. military personnel: meta-analysis and simulation. Military Medicine, 177(8 Suppl), 47-59.
11. Heeringa S.G., Colpe L.J., Fullerton C.S., Gebler N., Naifeh J.A., Nock M.K., Sampson N.A., Schoenbaum M., Zaslavsky A.M., Stein M.B., Ursano R.J., Kessler R.C. (2013) Field procedures in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). International Journal of Methods and Psychiatric Research, 22(4), 276-287.
12. Heeringa S.G., West B.T., Berglund P.A. (2010) Applied Survey Data Analysis. Boca Raton, FL: Taylor and Francis.
13. Kessler R.C., Colpe L.J., Fullerton C.S., Gebler N., Naifeh J.A., Nock M.K., Sampson N.A., Schoenbaum M., Zaslavsky A.M., Stein M.B., Ursano R.J., Heeringa S.G. (2013) Design of the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). International Journal of Methods in Psychiatric Research, 22(4), 267-275.
14. Kish L. (1965) Survey Sampling. New York: John Wiley and Sons.
15. Kish L. (1976) Optima and proxima in linear sample designs. Journal of the Royal Statistical Society, Series A, 139(1), 80-95.
16. Kish L., Frankel M.R. (1974) Inference from complex samples. Journal of the Royal Statistical Society, Series A, 36(1), 1-37.
17. Little R.J.A., Vartivarian S. (2005) Does weighting for nonresponse increase the variance of survey means? Survey Methodology, 31(2), 161-168.
18. Ong A.D., Weiss D.J. (2000) The impact of anonymity on responses to "sensitive" questions. Journal of Applied Social Psychology, 30(8), 1691-1708, DOI: 10.1111/j.1559-1816.2000.tb02462.x.
19. Rogers S.M., Miller H.G., Turner C.F. (1998) Effects of interview mode on bias in survey measurements of drug use: do respondent characteristics make a difference? Substance Use and Misuse, 33(10), 2179-2200, DOI: 10.3109/10826089809069820.
20. Ryan M.A., Smith T.C., Smith B., Amoroso P., Boyko E.J., Gray G.C., Gackstetter G.D., Riddle J.R., Wells T.S., Gumbs G., Corbeil T.E., Hooper T.I. (2007) Millennium Cohort: enrollment begins a 21-year contribution to understanding the impact of military service. Journal of Clinical Epidemiology, 60(2), 181-191, 10.1016/j.jclinepi.2006.05.009.
21. Schafer J.L. (1999) Multiple imputation: a primer. Statistical Methods in Medical Research, 8(1), 3-15, DOI: 10.1177/096228029900800102.
22. Turner C.F., Ku L., Rogers S.M., Lindberg L.D., Pleck J.H., Sonenstein F.L. (1998) Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science, 280(5365), 867-873, DOI:10.1126/science.280.5365.867.
23. Ursano R.J., Heeringa S., Stein M.B., Kessler R.C. (submitted for publication) The Army Study to Assess Risk and Resilience in Servicemembers (STARRS).
24. Warner C.H., Appenzeller G.N., Grieger T., Belenkiy S., Breitbach J., Parker J., Warner C.M., Hoge C. (2011) Importance of anonymity to encourage honest reporting in mental health screening after combat deployment. Archives of General Psychiatry, 68(10), 1065-1071, DOI: 10.1001/archgenpsychiatry.2011.112.
25. Warner C.H., Appenzeller G.N., Mullen K., Warner C.M., Grieger T. (2008) Soldier attitudes toward mental health screening and seeking care upon return from combat. Military Medicine, 173(6), 563-569.
26. Warner C.H., Breitbach J.E., Appenzeller G.N., Yates V., Grieger T., Webster W.G. (2007) Division mental health in the new brigade combat team structure: part II. Redeployment and postdeployment. Military Medicine, 172(9), 912-917.
27. Werch C.E. (1990) Two procedures to reduce response bias in reports of alcohol consumption. Journal of Studies on Alcohol, 51(4), 327-330.
28. Wolter K.M. (1985) Introduction to Variance Estimation. New York: Springer-Verlag.
29. Zaslavsky A.M., Schenker N., Belin T.R. (2001) Downweighting influential clusters in surveys: application to the 1990 Post Enumeration Survey. Journal of the American Statistical Association, 96(455), 858-869, DOI: 10.1198/016214501753208889.