Effects of validity screening items on adolescent survey data

Psychological Assessment

Volumn 24, Issue 1, 2012, Pages 21-35

  Cornell, Dewey ^a   Klein, Jennifer ^a   Konold, Tim ^a   Huang, Francis ^a  

^a UNIVERSITY OF VIRGINIA   (United States)

Author keywords

Adolescent risk behavior; School surveys; Self report; Validity screening

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; CONTROLLED STUDY; CORRELATION ANALYSIS; FEMALE; HEALTH SURVEY; HIGH RISK BEHAVIOR; HUMAN; MALE; PERCEPTION; PREVALENCE; PSYCHOLOGIC ASSESSMENT; QUALITY CONTROL; RATING SCALE; SCHOOL; SCREENING TEST; STUDENT; TEACHER; VALIDATION STUDY; ATTENTION; BULLYING; CHILD; CHILD PSYCHOLOGY; DECEPTION; EVALUATION; FACTORIAL ANALYSIS; INFORMATION PROCESSING; ORGANIZATION; ORGANIZATION AND MANAGEMENT; PSYCHOLOGICAL ASPECT; REPRODUCIBILITY; RESEARCH SUBJECT; STANDARD; STATISTICAL ANALYSIS; STATISTICS; UNIVERSITY;

ADOLESCENT; ADOLESCENT PSYCHOLOGY; ATTENTION; BULLYING; CHILD; DATA COLLECTION; DATA INTERPRETATION, STATISTICAL; DECEPTION; FACTOR ANALYSIS, STATISTICAL; FACULTY; FEMALE; HUMANS; MALE; ORGANIZATIONAL CULTURE; PREVALENCE; REPRODUCIBILITY OF RESULTS; RESEARCH SUBJECTS; RISK-TAKING; SCHOOLS; STUDENTS; YOUNG ADULT;

EID: 84863090880     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0024824     Document Type: Article

References (63)

1. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2. American School Health Association. (1989). National adolescent student health survey (NASHS). A report on the health of America's youth. Oakland, CA: Third Party.
3. Arbuckle, J. L. (2007). Amos16.0 user's guide, Chicago, IL: SPSS.
4. Baly, M. W., & Cornell, D. G. (in press). Effects of an educational video on the measurement of bullying by self-report. Journal of School Violence.
5. Bandyopadhyay, S., Cornell, D. G., & Konold, T. R. (2009). Internal and external validity of three school climate scales from the School Climate Bullying Survey. School Psychology Review, 38, 338-355.
6. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodnessof-fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606. doi:10.1037/0033-2909.88.3.588
7. Branson, C., & Cornell, D. (2009). A comparison of selfand peer reports in the assessment of middle school bullying. Journal of Applied School Psychology, 25, 5-27. doi:10.1080/15377900802484133
8. Brener, N. D., Kann, L., Kinchen, S. A., Grunbaum, J. A., Whalen, L., Eaton, D., Ross, J. G. (2004). Methodology of the Youth Risk Behavior Surveillance System. MMWR Morbidity and Mortality Weekly Report, 53, 1-13.
9. Brener, N. D., McManus, T., Galuska, D. A., Lowry, R., & Wechsler, H. (2003). Reliability and validity of self-reported height and weight among high school students. Journal of Adolescent Health, 32, 281-287. doi: 10.1016/S1054-139X(02)00708-5
10. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
11. Butcher, J. N., Williams, C. L., Graham, J. R., Archer, R. P., Tellegen, A., Ben-Porath, Y. S., & Kaemmer, B. (1992). Minnesota Multiphasic Personality Inventory-Adolescent: Manual for administration scoring and interpretation. Minneapolis MN: University of Minnesota Press.
12. California Healthy Kids Survey. (2010). California Healthy Kids Survey, 2007-09. Statewide results: Main report. San Francisco, CA: WestEd Health and Human Development Program for the California Department of Education.
13. Carolina Population Center. (n.d.). Add health. Retrieved from http://www.cpc.unc.edu/projects/addhealth
14. Celis, W. (1994, August 31). Schools getting tough on guns in the classroom. The New York Times. Retrieved from http://www.nytimes.com/1994/08/31/us/schools-getting-tough-on-guns-in-the-classroom.html?n=Top%2FReference%2FTimes+Topics%2FPeople%2FC%2FCelis%2C+William+III&pagewanted=all
15. Centers for Disease Control and Prevention. (2010). Youth risk behavior surveillance-United States, 2009. MMWR Morbidity and Mortality Weekly Report, 59(Serial No. SS-5).
16. Chan, H. F. J., Myron, R., & Crawshaw, M. (2005). The efficacy of non-anonymous measures of bullying. School Psychology International, 26, 443-458.
17. Chromy, J. R. (1998). The effects of finite sampling corrections on state assessment sample requirements. NAEP validity studies (Report No. ED460134). Washington, DC: American Institutes for Research. Retrieved from http://eric.ed.gov/ERICWebPortal/custom/portlets/recordDetails/detailmini.jsp?_nfpb=true&_&ERICExtSearch_SearchValue_0=ED460134&ERICExtSearch_SearchType_0=no&accno=ED460134
18. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159. doi:10.1037/0033-2909.112.1.155
19. Cornell, D. G. (2006). School violence: Fears versus facts. Hillsdale, NJ: Erlbaum.
20. Cornell, D. G. (2011). The school climate bullying survey: Description and research summary. Unpublished manuscript, Curry School of Education, University of Virginia, Charlottesville, Virginia.
21. Cornell, D., & Brockenbrough, K. (2004). Identification of bullies and victims: A comparison of methods. Journal of School Violence, 3, 63-87. doi:10.1300/J202v03n02_05
22. Cornell, D., & Gregory, A. (2008). Virginia high school safety study: Descriptive report of survey results from ninth grade students and teachers. Charlottesville, VA: University of Virginia.
23. Cornell, D. G., & Loper, A. B. (1998). Assessment of violence and other high-risk behaviors with a school survey. School Psychology Review, 27, 317-330.
24. Cross, J., & Newman-Gonchar, R. (2004). Data quality in student risk behavior surveys and administrator training. Journal of School Violence, 3, 89-108.
25. Donegan, B. (2008). The linchpin year. Educational Leadership, 65, 54-57.
26. Fan, X., Miller, B., Christensen, M., Bayley, B., Park, K., Grotevant, H., Dunbar, N. (2002). Questionnaire and interview inconsistencies exaggerated differences between adopted and non-adopted adolescents in a national sample. Adoption Quarterly, 6, 7-27. doi:10.1300/ J145v06n02_02
27. Fan, X., Miller, B., Park, K., Winward, B., Christensen, M., Grotevant, H., & Tai, R. (2006). An exploratory study about inaccuracy and invalidity in adolescent self-report surveys. Field Methods, 18, 223-244. doi: 10.1177/152822X06289161
28. Furlong, M., Sharkey, J., Bates, M. P., & Smith, D. (2004). An examination of reliability, data screening procedures, and extreme response patterns for the Youth Risk Behavior Surveillance Survey. Journal of School Violence, 3, 109-130. doi:10.1300/J202v03n02_07
29. Hindelang, M. J., Hirschi, T., & Weis, J. G. (1979). Correlates of delinquency: The illusion of discrepancy between self-report and official measures. American Sociological Review, 44, 995-1014.
30. Hu, L., & Bentler, P. M. (1995). Evaluating model fit. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76-99). Thousand Oaks, CA: Sage.
31. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
32. Ingels, S. J. (1990). Findings from the NELS:88 base year student survey. (ERIC Document Reproduction Service No. ED319747) Chicago, IL: National Opinion Research Center.
33. Johnston, L. D., O'Malley, P. M., Bachman, J. G., & Schulenberg, J. E. (2010). Monitoring the future national survey results on drug use, 1975-2009: Volume I. Secondary school students (NIH Publication No. 10-7584). Bethesda, MD: National Institute on Drug Abuse.
34. Kaplan, D. (1990). Evaluating and modifying covariance structure models: A review and recommendation. Multivariate Behavioral Research, 25, 137-155. doi:10.1207/s15327906mbr2502_1
35. Kline, R. B. (2005). Principles and practice of structural equation modeling. New York, NY: Guilford Press.
36. Konold, T. R., & Glutting, G. G. (2008). ADHD and method variance: A latent variable approach applied to a nationally representative sample of college freshmen. Journal of Learning Disabilities, 41, 405-416. doi: 10.1177/0022219408321111
37. Konold, T. R., & Pianta, R. C. (2007). The influence of informants on ratings of children's behavioral functioning. Journal of Psychoeducational Assessment, 25, 222-236. doi:10.1177/0734282906297784
38. Levine, F. J., & Rosich, K. J. (1996). Social causes of violence: Crafting a science agenda. Washington, DC: American Sociological Association.
39. Maginnis, R. (1995). Violence in the schoolhouse: A ten year update. Washington, DC: Family Research Council.
40. Marsh, H. W., Hau, K., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers of over generalizing Hu and Bentler's (1999) finding. Structural Equation Modeling, 11, 320-341. doi:10.1207/ s15328007sem1103_2
41. Midgley, C., Maehr, M., Hruda, L., Anderman, E., & Freeman, K. (2000). Manual for patterns of adaptive learning. Ann Arbor, MI: The University of Michigan.
42. Miller, B. C., Fan, X., Christensen, M., Grotevant, H. D., & van Dulmen, M. (2000). Comparisons of adopted and nonadopted adolescents in a large, nationally representative sample. Child Development, 71, 1458-1473. doi:10.1111/1467-8624.00239
43. Millon, T., Millon, C., Davis, R., & Grossman, S. (2006). MACI manual (2nd ed.). Minneapolis, MN: NCS Pearson.
44. National Center for Education Statistics. (2005). School crime supplement to the national crime victimization survey 2005. Retrieved from http://nces.ed.gov/Programs/Crime/surveys.asp
45. National Crime Prevention Council. (1995). Strategy: Gun-free school zones. Retrieved from http://www.ncpc.org/ncpc/ncpc/?pg=2088-10796
46. National Education Association. (2005). Statistics: Gun violence in our communities. Retrieved from http://www.neahin.org/programs/schoolsafety/gunsafety/statistics.htm
47. National School Boards Association. (1993). Violence in the schools: How America's school boards are safeguarding your children. Alexandria, VA: Author.
48. O'Malley, P. M., Johnston, L. D., Bachman, J. G., & Schulenberg, J. E. (2000). A comparison of confidential versus anonymous survey procedures: Effects on reporting of drug use and related attitudes and beliefs in a national study of students. Journal of Drug Issues, 30, 35-54.
49. Podsakoff, P. M., KacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903. doi:10.1037/0021-9010.88.5.879
50. R Development Core Team. (2009). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org
51. Revelle, W. (2010). Psych: Procedures for psychological, psychometric, and personality research. Retrieved from http://www.personality-project.org/R/psych.manual.pdf
52. Robers, S., Zhang, J., & Truman, J. (2010). Indicators of school crime and safety. (Report No. NCES 2011-002/NCJ 230812). Washington, DC: National Center for Education Statistics, U.S. Department of Education, and Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice.
53. Rosenblatt, J. A., & Furlong, M. J. (1997). Assessing the reliability and validity of student self-reports of campus violence. Journal of Youth and Adolescence, 26, 187-202. doi:10.1023/A:1024552531672
54. Sharkey, J. D., Furlong, M. J., & Yetter, G. (2006). An overview of measurement issues in school violence and school safety research. In S. R. Jimerson & M. J. Furlong (Eds.), The handbook of school violence and school safety: From research to practice (pp. 121-134). Mahwah, NJ: Erlbaum.
55. Singer, C. (2005). School-by-school reform. Retrieved from http://www.pbs.org/makingschoolswork/sbs/csp/tension.html
56. Solberg, M., & Olweus, D. (2003). Prevalence estimation of school bullying with the Olweus Bully/Victim Questionnaire. Aggressive Behavior, 29, 239-268.
57. Streiner, D. L. (2003). Being inconsistent about consistency: When coefficient alpha does and doesn't matter. Journal of Personality Assessment, 80, 217-222. doi:10.1207/S15327752JPA8003_01
58. Tanaka, J. S. (1993). Multifaceted conceptions of fit in structural equation modeling. In K. S. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 10-39). Newbury Park, CA: Sage.
59. Ttofi, M. M., & Farrington, D. P. (2009). What works in preventing bullying: Effective elements of anti-bullying programmes. Journal of Aggression, Conflict and Peace Research, 1, 13-24.
60. U.S. Department of Health and Human Services. (2009). United States high school survey data user's manual. Rockville, MD: Author.
61. U.S. Office of Juvenile Justice and Delinquency Prevention. (n.d.). Juvenile justice reform initiatives in the states: 1994-1996. Retrieved from http://www.ojjdp.gov/pubs/reform/ch1_c.html
62. Williams, F., & Cornell, D. (2006). Student willingness to seek help for threats of violence. Journal of School Violence, 5, 35-49. doi:10.1300/ J202v05n04_04
63. Witkin, G. (1991, April 8). Kids who kill; disputes once settled with fists are now settled with guns. U.S. News & World Report, 110, 26-32.