Inaccurate estimation of disparities due to mischievous responders: Several suggestions to assess conclusions

Educational Researcher

Volumn 43, Issue 4, 2014, Pages 171-185

  Robinson Cimpian, Joseph P ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Adolescents; And questioning; Bisexual; Disparities; Equity; Evaluation; Gay; Lesbian; Mischievous responders; Physical disabilities; Questionnaires; Self report; Sensitivity analysis; Survey research; Transgender

Indexed keywords

EID: 84905044597     PISSN: 0013189X     EISSN: 1935102X     Source Type: Journal    
DOI: 10.3102/0013189X14534297     Document Type: Article

References (56)

1. Anderson, K. (n.d.). Gay agenda in school-A Christian worldview perspective. Retrieved from http://www.probe.org/site/c.fdKEIMNsEoG/ b.4219121/k.48F3/Gay_Agenda_in_Schools.htm
2. Anderson, K. (2008). The Biblical point of view on homosexuality. Eugene, OR: Harvest House Publishers.
3. Badgett, M. V. L. (2009). Best practices for asking questions about sexual orientation on surveys. Los Angeles: The Williams Institute, UCLA. Retrieved from http://escholarship.org/uc/item/706057d5
4. Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6), 1173-1982. doi: 10.1037/0022-3514.51.6.1173
5. Blum, R. W., Kelly, A., & Ireland, M. (2001). Health-risk behaviors and protective factors among adolescents with mobility impairments and learning and emotional disabilities. Journal of Adolescent Health, 28, 481-490. doi: 10.1016/S1054-139X(01)00201-4
6. Bontempo, D. E., & D'Augelli, A. R. (2002). Effects of at-school victimization and sexual orientation on lesbian, gay, or bisexual youths' health risk behavior. Journal of Adolescent Health, 30, 364-374. doi: 10.1016/S1054-139X(01)00415-3
7. Centers for Disease Control and Prevention. (2011). Sexual identity, sex of sexual contacts, and health-risk behaviors among students in grades 9-12: Youth risk behavior surveillance, selected cities, United States, 2001-2009 (MMWR Early Release 60). Atlanta, GA: U.S. Department of Health and Human Services.
8. Cheng, M. M., & Udry, J. R. (2002). Sexual behaviors of physically disabled adolescents in the United States. Journal of Adolescent Health, 31, 48-58. doi: 10.1016/S1054-139X(01)00400-1
9. Coffman, K. B., Coffman, L. C., & Ericson, K. M. M. (2013). The size of the LGBT population and the magnitude of anti-gay sentiment are substantially underestimated (No. w19508). Cambridge, MA: National Bureau of Economic Research.
10. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
11. Cornell, D., Klein, J., Konold, T., & Huang, F. (2012). Effects of validity screening items on adolescent survey data. Psychological Assessment, 24, 21-35. doi: 10.1037/a0024824
12. D'Augelli, A. R., & Grossman, A. H. (2006). Researching lesbian, gay, and bisexual youth: Conceptual, practical, and ethical considerations. Journal of Gay and Lesbian Issues in Education, 3, 35-56. doi: 10.1300/J367v03n02_03
13. Espelage, D. L., Aragon, S. R., Birkett, M., & Koenig, B. (2008). Homophobic teasing, psychological outcomes, and sexual orientation among high school students: What influence do parents and schools have? School Psychology Review, 37(2), 202-216.
14. Fan, X. (2003). Correction to data and conclusions. Child Development, 74, 65. doi: 10.1111/1467-8624.00579
15. Fan, X., Miller, B. C., Christensen, M., Park, K.-E., Grotevant, H. D., van Dulmen, M., et al. (2002). Questionnaire and interview inconsistencies exaggerated differences between adopted and nonadopted adolescents in a national sample. Adoption Quarterly, 6, 7-27. doi: 10.1300/J145v06n02_02
16. Fan, X., Miller, B. C., Park, K., Winward, B. W., Christensen, M, Grotevant, H. D., et al. (2006). An exploratory study about inaccuracy and invalidity in adolescent self-report surveys. Field Methods, 18, 223-244. doi: 10.1177/152822X06289161
17. Fanelli, D., & Ioannidis, J. P. (2013). US studies may overestimate effect sizes in softer research. Proceedings of the National Academy of Sciences, 110, 15031-15036. doi: 10.1073/pnas.1302997110
18. Faulkner, A. H., & Cranston, K. (1998). Correlates of same-sex sexual behavior in a random sample of Massachusetts high school students. American Journal of Public Health, 88, 262-266. doi: 10.2105/AJPH.88.2.262
19. Garofalo, R., Wolf, R. C., Kessel, S., Palfrey, J., & DuRant, R. H. (1998). The association between health risk behaviors and sexual orientation among a school-based sample of adolescents. Pediatrics, 101, 895-902. doi: 10.1542/peds.101.5.895
20. Gelman, A. (in press). The connection between varying treatment effects and the current crisis of unreplicable research in social science. Journal of Management.
21. Glenn, G. (2002). Even Rosie knows homosexual adoption puts children at risk. Retrieved from http://www.freerepublic.com/focus/ news/648359/posts
22. Glynn, A. N. (2013). What can we learn with statistical truth serum? Design and analysis of the list experiment. Public Opinion Quarterly, 77(S1), 159-172. doi: 10.1093/poq/nfs070
23. Grant, J. E., Odlaug, B. L., Derbyshire, K., Schreiber, L. R., Lust, K., & Christenson, G. (in press). Mental health and clinical correlates in lesbian, gay, bisexual, and queer young adults. Journal of American College Health. doi: 10.1080/07448481.2013.844697
24. Harris, K. M., Gordon-Larsen, P., Chantala, K., & Udry, J. R. (2006). Longitudinal trends in race/ethnic disparities in leading health indicators from adolescence to young adulthood. Archives of Pediatrics & Adolescent Medicine, 160, 74-81. doi: 10.1001/archpedi.160.1.74
25. Hatzenbuehler, M. L. (2009). How does sexual minority stigma "get under the skin"? A psychological mediation framework. Psychological Bulletin, 135, 707-730. doi: 10.1037/a0016441
26. Imai, K., Keele, L., Tingley, D., & Yamamoto, T. (2011). Unpacking the black box of causality: Learning about causal mechanisms from experimental and observational studies. American Political Science Review, 105(4), 765-789. doi: 10.1017/S0003055411000414
27. Ioannidis, J. P. A. (2005a). Contradicted and initially stronger effects in highly cited clinical research. Journal of the American Medical Association, 294, 218-228. doi: 10.1001/jama.294.2.218
28. Ioannidis, J. P. A. (2005b). Why most published research findings are false. PLoS Medicine, 2, e124. doi: 10.1371/journal.pmed.0020124
29. Kreuter, F., Presser, S., & Tourangeau, R. (2008). Social desirability bias in CATI, IVR, and web surveys: The effects of mode and question sensitivity. Public Opinion Quarterly, 72(5), 847-865. doi: 10.1093/poq/nfn063
30. LeVasseur, M. T., Kelvin, E. A., & Grosskopf, N. A. (2013). Intersecting identities and the association between bullying and suicide attempt among New York City youths: Results from the 2009 New York City Youth Risk Behavior Survey. American Journal of Public Health, 103, 1082-1089. doi: 10.2105/AJPH.2012.300994
31. Marshal, M. P., Friedman, M. S., Stall, R., King, K. M., Miles, J., Gold, M. A., & Morse, J. Q. (2008). Sexual orientation and adolescent substance use: A meta-analysis and methodological review. Addiction, 103(4), 546-556. doi:10.1111/j.1360-0443.2008.02149.x
32. McCormack, M. (2011). The declining significance of homohysteria for male students in three sixth forms in the south of England. British Educational Research Journal, 37(2), 337-353. doi: 10.1080/01411921003653357
33. McRee, A. L., Haydon, A. A., & Halpern, C. T. (2010). Reproductive health of young adults with physical disabilities in the US. Preventive Medicine, 51, 502-504. doi: 10.1016/j.ypmed.2010.09.006
34. Meyer, I. H. (2003). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychological Bulletin, 129, 674-697. doi: 10.1037/0033-2909.129.5.674
35. Miller, B. C., Fan, X., Christensen, M., Grotevant, H. D., & Van Dulmen, M. (2000). Comparisons of adopted and nonadopted adolescents in a large, nationally representative sample. Child Development, 71, 1458-1473. doi: 10.1111/1467-8624.00239
36. Mood, C. (2010). Logistic regression: Why we cannot do what we think we can do, and what we can do about it. European Sociological Review, 26, 67-82. doi: 10.1093/esr/jcp006
37. Moss, P. A., Phillips, D. C., Erickson, F. D., Floden, R. E., Lather, P. A., & Schneider, B. L. (2009). Learning from our differences: A dialogue across perspectives on quality in education research. Educational Researcher, 38(7), 501-517. doi: 10.3102/0013189X09348351
38. Poteat, V. P., Mereish, E. H., DiGiovanni, C. D., & Koenig, B. W. (2011). The effects of general and homophobic victimization on adolescents' psychosocial and educational concerns: The importance of intersecting identities and parent support. Journal of Counseling Psychology, 58, 597-609. doi: 10.1037/a0025095
39. Poulin, C., MacNeil, P., & Mitic, W. (1993). The validity of a province-wide student drug use survey: Lessons in design. Canadian Journal of Public Health, 84, 259-264.
40. Robinson, J. P., & Espelage, D. L. (2011). Inequities in educational and psychological outcomes between LGBTQ and straight students in middle and high school. Educational Researcher, 40, 315-330. doi: 10.3102/0013189X11422112
41. Robinson, J. P., & Espelage, D. L. (2012). Bullying explains only part of LGBTQ-heterosexual risk disparities: Implication for policy and practice. Educational Researcher, 41, 309-319. doi: 10.3102/0013189X12457023
42. Robinson, J. P., & Espelage, D. L. (2013). Peer victimization and sexual risk differences between lesbian, gay, bisexual, transgender or questioning and nontransgender heterosexual youths in grades 7-12. American Journal of Public Health, 103(10), 1810-1819. doi: 10.2105/AJPH.2013.301387
43. Russell, S. T. (2005). Beyond risk: Resilience in the lives of sexual minority youth. Journal of Gay and Lesbian Issues in Education, 2, 5-18. doi: 10.1300/J367v02n03_02
44. Russell, S. T., & Joyner, K. (2001). Adolescent sexual orientation and suicide risk: Evidence from a national study. American Journal of Public Health, 91, 1276-1281. doi: 10.2105/AJPH.91.8.1276
45. Russell, S. T., Sinclair, K. O., Poteat, V. P., & Koenig, B. W. (2012). Adolescent health and harassment based on discriminatory bias. American Journal of Public Health, 102, 493-495. doi: 10.2105/ AJPH.2011.300430
46. Saewyc, E. M. (2011). Research on adolescent sexual orientation: Development, health disparities, stigma, and resilience. Journal of Research on Adolescence, 21, 256-272. doi: 10.1111/j.1532-7795.2010.00727.x
47. Saewyc, E. M., Bauer, G. R., Skay, C. L., Bearinger, L. H., Resnick, M. D, Reis, E., & Murphy, A. (2004). Measuring sexual orientation in adolescent health surveys: Evaluation of eight school-based surveys. Journal of Adolescent Health, 35, e1-e16. doi: 10.1016/j. jadohealth.2004.06.002
48. Saewyc, E. M., Skay, C. L., Hynds, P., Pettingell, S., Bearinger, L. H., Resnick, M. D., & Reis, E. (2008). Suicidal ideation and attempts among adolescents in North American school-based surveys: Are bisexual youth at increasing risk? Journal of LGBT Health Research, 3(2), 25-36. doi: 10.1300/J463v03n02_04
49. Saewyc, E., Skay, C., Richens, K., Reis, E., Poon, C., & Murphy, A. (2006). Sexual orientation, sexual abuse, and HIV-risk behaviors among adolescents in the Pacific Northwest. American Journal of Public Health, 96(6), 1104-1110. doi: 10.2105/AJPH.2005.065870
50. Savin-Williams, R. C. (2001). A critique of research on sexual-minority youths. Journal of Research on Adolescence, 24, 5-13. doi: 10.1006/ jado.2000.0369
51. Savin-Williams, R. C. (2005). The new gay teenager. Cambridge, MA: Harvard University Press.
52. Savin-Williams, R. C., & Joyner, K. (in press). The dubious assessment of gay, lesbian, and bisexual adolescents of Add Health. Archives of Sexual Behavior. doi: 10.1007/s10508-013-0219-5
53. Tourangeau, R., & Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin, 133, 859-883. doi: 10.1037/0033-2909.133.5.859
54. Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., & Sonenstein, F. L. (1998). Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science, 280, 867-873. doi: 10.1126/science.280.5365.867
55. Wolter, F., & Preisendörfer, P. (2013). Asking sensitive questions: An evaluation of the randomized response technique versus direct questioning using individual validation data. Sociological Methods & Research, 42(3), 321-353. doi: 10.1177/0049124113500474
56. Reardon S. F., & Firebaugh G. (2002). Measures of multigroup segregation. Sociological Methodology, 32(1), 33-67.