Intervention effectiveness research in adolescent health psychology: Methodological issues and strategies

Handbook of Adolescent Health Psychology

Volumn , Issue , 2013, Pages 295-322

  Constantine, Norman A ^a,b  

^a PUBLIC HEALTH INSTITUTE   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84902328637     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-1-4614-6633-8_20     Document Type: Chapter

References (151)

1. Abel, U., & Koch, A. (1999). The role of randomization in clinical studies: Myths and beliefs. Journal of Clinical Epidemiology, 52, 487-497. doi:10.1016/S0895-4356(99)00041-4.
2. Abelson, R. (1995). Statistics as principled argument. Hillsdale, NJ: Erlbaum.
3. Abi-Jaoude, E., & Gorman, D. A. (2010). Disclosure: Only a first step. Canadian Medical Association Journal, 182, 1546. doi:10.1503/cmaj.110-2109.
4. Advocates for Youth. (2008). Science and success: Sex education and other programs that work to prevent teen pregnancy, HIV & sexually transmitted infections (2nd ed.). Retrieved June 6, 2011, from http://www.advocatesforyouth.org/storage/advfy/documents/sciencesuccess.pdf.
5. Altman, D. G. (2002). Poor quality medical research: What can journals do? Journal of the American Medical Association, 287, 2765-2767. doi:10.1001/jama.287.21.2765.
6. Anderson, N. H. (1963). Comparison of different populations: Resistance to extinction and transfer. Psychological Review, 70, 162-179. doi:10.1037/h0044858.
7. Bachrach, C., & Newcomer, S. F. (2002). Addressing bias in intervention research: Summary of a workshop. Journal of Adolescent Health, 31, 311-321. doi:10.1016/S1054-139X(02)00395-6.
8. Bakker, M., & Wicherts, J. M. (2011). The (mis)reporting of statistical results in psychology. Behavior Research Methods, 43, 666-678. doi:10.3758/s13428-011-0089-5.
9. Bearman, P. S., & Bruckner, H. (2001). Promising the future: Virginity pledges and first intercourse. American Journal of Sociology, 106, 859-912. doi:10.1086/320295.
10. Berle, D., & Starcevic, V. (2007). Inconsistencies between reported test statistics and p-values in two psychiatry journals. International Journal of Methods in Psychiatric Research, 16, 202-207. doi:10.1002/mpr.225.
11. Berliner, D. (2002). Comment: Educational research: The hardest science of all. Educational Researcher, 31(8), 18-20. doi:10.3102/0013189X031008018.
12. Brady, H. E., & Collier, D. (Eds.). (2010). Rethinking social inquiry: Diverse tools, shared standards (2nd ed.). Lanham, MD: Rowman and Littlefield.
13. Briggs, D. C. (2005). Meta-analysis: A case study. Evaluation Review, 29, 87-127. doi:10.1177/0193841X04272555.
14. Cain, D. M., & Detsky, A. S. (2008). Everyone's a little bit biased (even physicians). Journal of the American Medical Association, 299, 2893-2895. doi:10.1001/jama.299.24.2893.
15. Campbell, D. T. (1953). Designs for social science experiments. Evanston, IL: Northwestern University.
16. Campbell, D. T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54, 297-312. doi:10.1037/h0040950.
17. Campbell, D. T. (1982). Experiments as arguments. In E. R. House, S. Mathison, J. A. Pearsol, & H. Preskill (Eds.), Evaluation studies review annual (Vol. 7, pp. 117-127). Beverly Hills, CA: Sage.
18. Campbell, D. T. (2009). Forward. In R. K. Yin (Ed.), Case study research: Design and methods (4th ed.)pp. viiviii). Thousand Oaks, CA: Sage.
19. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Boston: Houghton-Mifflin.
20. Carter, H. (2004). Presidential perspective. In M. T. Braverman, N. A. Constantine, & J. K. Slater (Eds.), Foundations and evaluation: Contexts and practices for effective philanthropy. San Francisco: Jossey-Bass.
21. Centers for Disease Control and Prevention. (2008). 10 steps to promoting science-based approaches to teen pregnancy prevention using Getting To Outcomes: A summary. Retrieved from http://www.cdc.gov/reproductivehealth/adolescentreprohealth/PDF/LittlePSBAGTO.pdf.
22. Chan, A. W., Hrobjartsson, A., Haahr, M. T., Gotzsche, P. C., & Altman, D. G. (2004). Empirical evidence for selective reporting of outcomes in randomized trials: Comparison of protocols to published articles. Journal of the American Medical Association, 291, 2457-2465. doi:10.1001/jama.291.20.2457.
23. Chen, S., & Chaiken, S. (1999). The heuristic-systematic model in its broader context. In S. Chaiken & Y. Trope (Eds.), Dual-process theories in social psychology (pp. 73-96). New York: Guilford.
24. Chinn, C. A., & Brewer, W. F. (2001). Models of data: A theory of how people evaluate data. Cognition and Instruction, 19, 323-393. Retrieved from http://www.jstor.org/stable/3233918.
25. Chugh, D., Banaji, M., & Bazerman, M. (2005). Bounded ethicality as a psychological barrier to recognizing conflicts of interest. In D. Moore, D. Cain, G. Loewenstein, & M. Bazerman (Eds.), Conflicts of interest: Challenges and solutions in business, law, medicine, and public policy. New York: Cambridge University Press.
26. Coalition for Evidence-Based Policy. (2010). HHS's evidence-based teen pregnancy prevention program. Retrieved June 6, 2011, from http://coalition4evidence.org/wordpress/wp-content/uploads/Coalition-comments-HHS-Teen-Pregnancy-Prevention-May-2010.pdf.
27. Collins, J., Robin, L., Wooley, S., Fenley, D., Hunt, P., Taylor, J., et al. (2002). Programs-that-work: CDC's guide to effective programs that reduce health-risk behavior of youth. Journal of School Health, 72, 93-99. doi:10.1111/j.1746-1561.2002.tb06523.x.
28. Constantine, N. A. (2008a). Converging evidence leaves policy behind: Effectiveness of and support for school-based sex education programs [Editorial]. Journal of Adolescent Health, 42, 324-326. doi:10.1016/j.jadohealth.2008.01.004.
29. Constantine, N. A. (2008b). The peer review process. In S. Boslaugh (Ed.), Encyclopedia of epidemiology (Vol. 1, pp. 794-796). Thousand Oaks, CA: Sage.
30. Constantine, N. A. (2008c). Publication bias. In S. Boslaugh (Ed.), Encyclopedia of epidemiology (Vol. 1, pp. 853-854). Thousand Oaks, CA: Sage.
31. Constantine, N. A. (2012). Regression analysis and causal inference: Cause for concern? Perspectives on Sexual and Reproductive Health, 44, 134-137. doi:10.1363/4413412.
32. Constantine, N. A., & Braverman, M. T. (2004). Appraising evidence on program effectiveness. In M. T. Braverman, N. A. Constantine, & J. K. Slater (Eds.), Foundations and evaluation: Contexts and practices for effective philanthropy (pp. 236-258). San Francisco: Jossey-Bass.
33. Cook, T. D. (2002). Randomized experiments in educational policy research: A critical examination of the reasons the educational evaluation community has offered for not doing them. Educational Evaluation and Policy Analysis, 24, 175-199. doi:10.3102/01623737024003175.
34. Cook, T. D., & Campbell, D. T. (1979). Quasiexperimentation: Design and analysis issues for field settings. Chicago: Rand-McNally.
35. Cronbach, L. J. (1982). Designing evaluations of educational and social programs. San Francisco: Jossey-Bass.
36. Dane, A. U., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23-45. doi:10.1016/S0272-7358(97)00043-3.
37. Davey Smith, G., & Ebrahim, S. (2001). Epidemiology-is it time to call it a day? International Journal of Epidemiology, 30, 1-11. doi:10.1093/ije/30.1.1.
38. Dawson, E., Gilovich, T., & Regan, D. T. (2002). Motivated reasoning and performance on the Wason Selection Task. Personality and Social Psychology Bulletin, 28, 1379-1387. doi:10.1177/014616702236869.
39. DiCenso, A., Guyatt, G., Willan, A., & Griffith, L. (2002). Interventions to reduce unintended pregnancies among adolescents: Systematic review of randomized controlled trials. British Medical Journal, 324, 1426-1434. doi:10.1136/bmj.324.7351.1426.
40. Dishion, T. J., & Patterson, G. R. (1999). Model building in developmental psychopathology: A pragmatic approach to understanding and intervention. Journal of Clinical Child Psychology, 28, 502-512. doi:10.1207/S15374424JCCP2804_10.
41. Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., et al. (2008). Systematic review of the empirical evidence of study publication bias and outcome reporting bias. Public Library of Science (PLoS) ONE, 3, e3081. doi:10.1371/journal.pone.0003081.
42. Egger, M., & Davey Smith, G. (1997). Meta-analysis: Potentials and promise. British Medical Journal, 315, 1371-1374.
43. Evans, J. (1989). Bias in human reasoning: Causes and consequences. London: Erlbaum.
44. Feinstein, A. R. (1988). Fraud, distortion, delusion, and consensus: The problems of human and natural deception in epidemiologic science. American Journal of Medicine, 84(3, Pt. 1), 475-478. doi:10.1016/0002-9343(88)90268-9.
45. Feuer, M. J., Towne, L., & Shavelson, R. J. (2002). Scientific cultureandeducationalresearch. Educational Researcher, 31(8), 4-14. doi:10.3102/0013189X031008004.
46. Freedman, D. A. (2008). On types of scientific inquiry: The role of qualitative reasoning. In J. M. Box-Steffensmeier, H. E. Brady, & D. Collier (Eds.), The Oxford handbook of political methodology (pp. 300-318). New York: Oxford University Press.
47. Freedman, D. A. (2010). Statistical models and causal inference: A dialogue with the social sciences. Cambridge, UK: Cambridge University Press.
48. Friedlander, F. (1964). Type I and Type II bias. American Psychologist, 19, 198-199. doi:10.1037/h0038977.
49. Gandhi, A. G., Murphy-Graham, E., Petrosino, A., Chrismer, S. S., & Weiss, C. H. (2007). The devil is in the details: Examining the evidence for "proven" school-based drug abuse prevention programs. Evaluation Review, 31, 43-74. doi:10.1177/0193841X06287188.
50. Garcia-Berthou, E., & Alcaraz, C. (2004). Incongruence between test statistics and P values in medical papers. BMC Medical Research Methodology, 4, 13. doi:10.1186/1471-2288-4-13.
51. Gigerenzer, G. (1998). Surrogates for theories. Theories & Psychology, 8, 195-204. doi:10.1177/0959354398082006.
52. Gigerenzer, G. (2009). Surrogates for theory. Association for Psychological Science Observer, 22, 21-23.
53. Gigerenzer, G., & Selten, R. (Eds.). (2002). Bounded rationality: The adaptive toolbox. Cambridge, MA: The MIT Press.
54. Goldfarb, E. S., & Constantine, N. A. (2011). Sexuality education. In B. B. Brown & M. Prinstein (Eds.), Encyclopedia of adolescence. New York: Academic.
55. Gorman, D. M. (2002). Defining and operationalizing 'research-based' prevention: A critique (with case studies) of the US Department of Education's Safe, Disciplined and Drug-Free Schools exemplary programs. Evaluation and Program Planning, 25, 295-302.
56. Gorman, D. M., & Conde, E. (2007). Conflict of interest in the evaluation and dissemination of "model" school-based drug and violence prevention programs. Evaluation and Program Planning, 30, 422-429. doi:10.1016/j.evalprogplan.2007.06.004.
57. Grossman, D. C., Neckerman, H. J., Koespell, T. D., Liu, P. Y., Asher, K. N., Beland, K., et al. (1997). Effectiveness of a violence prevention curriculum among children in elementary school: A randomized controlled trial. Journal of the American Medical Association, 277, 1605-1611. doi:10.1001/jama.1997.03540440039030.
58. Haack, S. (2003). Defending science-within reason: Between scientism and cynicism. New York: Prometheus.
59. Hahn, S., Williamson, P. R., & Hutton, J. L. (2002). Investigation of within-study selective reporting in clinical research: Follow-up of applications submitted to a local research ethics committee. Journal of Evaluation in Clinical Practice, 8, 353-359. doi:10.1046/j.1365-2753.2002.00314.x.
60. Hahn, S., Williamson, P. R., Hutton, J. L., Garner, P., & Flynn, V. (2000). Assessing the potential for bias in metaanalysis due to selective reporting of subgroup analyses within studies. Statistics in Medicine, 19, 3325-3336. doi:10.1002/1097-0258(20001230)19:24<3325::AID-SIM827>3.0.CO;2-D.
61. Hinshaw, S. P. (2002). Intervention research, theoretical mechanisms, and causal processes related to externalizing behavior patterns. Development and Psychopathology, 14, 789-818. doi:10.1017/S0954579402004078.
62. Hirsch, E. D. (2002). Classroom research and cargo cults. Policy Review, 115, 51-69.
63. Horton, R. (1998). The grammar of interpretive medicine. Canadian Medical Association Journal, 159, 245-249.
64. Howel, D., & Bhopal, R. (1994). Assessing cause and effect from trials: A cautionary note. Controlled Clinical Trials, 15, 331-334. doi:10.1016/0197-2456(94)90030-2.
65. Hughes, J. N. (2000). The essential role of theory in the science of treating children: Beyond empirically supported treatments. Journal of School Psychology, 38, 301-330. doi:10.1016/S0022-4405(00)00042-X.
66. Huston, P., & Moher, D. (1996). Redundancy, disaggregation, and the integrity of medical research. The Lancet, 347, 1024-1026. doi:10.1016/S0140-6736(96)90153-1.
67. Ioannidis, J. P. A. (2005). Why most published research findings are false. Library of Science (PLoS) Medicine, 2, 696-701. doi:10.1371/journal.pmed.0020124.
68. Ioannidis, J. P. A. (2007). Limitations are not properly acknowledged in the scientific literature. Journal of Clinical Epidemiology, 60, 324-329. doi:10.1016/j.jclinepi.2006.09.011.
69. Ioannidis, J. P. A. (2011). An epidemic of false claims: Competition and conflicts of interest distort too many medical findings. Scientific American, 304, 16. Retrieved from http://www.scientificamerican.com/article.cfm?id=an-epidemic-of-false-claims.
70. Ioannidis, J. P. A., & Karassa, F. B. (2010). The need to consider the wider agenda in systematic reviews and meta-analyses: Breadth, timing, and depth of the evidence. British Medical Journal, 341, c4875. doi:10.1136/bmj.c4875.
71. Ioannidis, J. P. A., Tatsioni, A., & Karassa, F. B. (2010). Who is afraid of reviewers' comments? Or, why anything can be published and anything can be cited. European Journal of Clinical Investigation, 40, 285-287. doi:10.1111/j.1365-2362.2010.02272.x.
72. Jacobs, J. J., & Klaczynski, P. A. (2005). The development of judgment and decision making in children and adolescents. Mahwah, NJ: LEA.
73. Johnson, B. T., Scott-Sheldon, L. A. J., Huedo-Medina, T. B., & Carey, M. P. (2011). Interventions to reduce sexual risk for human immunodeficiency virus in adolescents: A meta-analysis of trials, 1985-2008. Archives of Pediatrics & Adolescent Medicine, 165, 77-84. doi:10.1001/archpediatrics.2010.251.
74. Kassirer, J. P., & Angell, M. (1995). Redundant publication: A reminder [Editorial]. New England Journal of Medicine, 333, 449-450. Retrieved from http://www.nejm.org/doi/pdf/10.1056/NEJM199508173330709.
75. Kazdin, A. E. (1997). A model for developing effective treatments: Progression and interplay of theory, research, and practice. Journal of Clinical Child Psychology, 26, 114-129.
76. Kerr, N. L. (1998). HARKing (hypothesizing after the results are known). Personality and Social Psychology Review, 2, 196-217. doi:10.1207/s15327957pspr0203_4.
77. Kirby, D. (2007). Emerging answers 2007: Research findings on programs to reduce teen pregnancy and sexually transmitted diseases. Washington, DC: National Campaign to Prevent Teen and Unplanned Pregnancy.
78. Kohler, P. K., Manhart, L. E., & Lafferty, W. E. (2008). Abstinence-only and comprehensive sex education and the initiation of sexual activity and teen pregnancy. Journal of Adolescent Health, 42, 344-351. doi:10.1016/j.jadohealth.2007.08.026.
79. Koslowski, B. (1996). Theory and evidence: The development of scientific reasoning. Cambridge, MA: MIT Press/Bradford Books.
80. Koslowski, B., & Thompson, S. (2002). Theorizing is important, and collateral information constrains how well it is done. In P. Carruthers, S. Stich, & M. Siegal (Eds.), The cognitive basis of science (pp. 171-192). Cambridge, UK: Cambridge University Press.
81. Kotchick, B. A., Shaffer, A., & Forehand, R. (2001). Adolescent sexual risk behavior: A multi-system perspective. Clinical Psychology Review, 21, 493-519. doi:10.1016/S0272-7358(99)00070-7.
82. Kraemer, H. C., Kazdin, A. E., Offord, D. R., Kessler, R. C., Jensen, P. S., & Kupfer, D. J. (1997). Coming to terms with the terms of risk. Archives of General Psychiatry, 54, 337-343.
83. Kraemer, H. C., Lowe, K. K., & Kupfer, D. J. (2005). To your health: How to understand what research tells us about risk. Oxford, UK: Oxford University Press.
84. Krisberg, K. (2010). Teen pregnancy prevention focusing on evidence: Ineffective abstinence-only lessons being replaced with science. The Nation's Health, 40, 1-14. Retrieved from http://thenationshealth.aphapublications.org/content/40/3/1.1.full.
85. Kumar, M. N. (2008). A review of the types of scientific misconduct in biomedical research. Journal of Academic Ethics, 6, 211-228. doi:10.1007/s10805-008-9068-6.
86. Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108, 480-498. doi:10.1037/0033-2909.108.3.480.
87. Larzelere, R. E., Kuhn, B. R., & Johnson, B. (2004). The intervention selection bias: An underrecognized confound in intervention research. Psychological Bulletin, 130, 289-303. doi:10.1037/0033-2909.130.2.289.
88. Levy, D. A. (2010). Toolsof critical thinking: Metathoughts for psychology (2nd ed.). Long Grove, IL: Waveland.
89. Light, R. J., Singer, J. D., & Willett, J. B. (1990). By design: Planning research on higher education. Cambridge, MA: Harvard University Press.
90. Lipsey, M. W. (2004). The 2004 Claremont debate: Lipsey vs. Scriven. Determining causality in program evaluation & applied research: Should experimental evidence be the gold standard? Retrieved October 31, 2010, from http://www.cgu.edu/include/SBOS_2004_Debate.pdf.
91. Lochman, J. E. (2000). Theory and empiricism in intervention research: A dialectic to be avoided. Journal of School Psychology, 38, 359-338. doi:10.1016/S0022-4405(00)00038-8.
92. Lochman, J. E. (2006). Translation of research into interventions. International Journal of Behavioral Development, 30, 31-38. doi:10.1177/0165025406059971.
93. Lord, F. M. (1967). A paradox in the interpretation of group comparisons. Psychological Bulletin, 68, 304-305.
94. MacCoun, R. (1998). Biases in the interpretation and use of research results. Annual Review of Psychology, 49, 259-287. doi:10.1146/annurev.psych.49.1.259.
95. MacCoun, R. (2005). Conflicts of interest in public policy research. In D. A. Moore, D. M. Cain, G. Lowenstein, & M. H. Bazerman (Eds.), Conflicts of interest: Challenges and solutions in business, law, medicine, and public policy (pp. 233-262). Cambridge, UK: Cambridge University Press.
96. Machi, L. A., & McEvoy, B. T. (2009). The literature review. Thousand Oaks, CA: Corwin.
97. Mahoney, M. J. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer-review system. Cognitive Therapy and Research, 1, 161-175. doi:10.1007/BF01173636.
98. Matt, G. E., & Cook, T. D. (2009). Threats to the validity of generalized inferences. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 537-556). New York: Russell Sage Foundation.
99. Maxwell, J. A. (2004). Causal explanation, qualitative research, and scientific inquiry in education. Educational Researcher, 33(2), 3-11. doi:10.3102/0013189X033002003.
100. Maxwell, J. A. (2005). Qualitative research design: An interactive approach (2nd ed.). Thousand Oaks, CA: Sage.
101. McCartney, K., & Rosenthal, R. (2000). Effect size, practical importance, and social policy for children. Child Development, 71, 173-180. doi:10.1111/1467-8624.00131.
102. Meinert, C. L. (1986). Clinical trials: Design, conduct, and analysis. Oxford, UK: Oxford University Press.
103. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage.
104. Mills, J. L. (1993). Data torturing. New England Journal of Medicine, 329, 1196-1199.
105. Moore, D. A., Loewenstein, G., Tanlu, L., & Bazerman, M. H. (2003). Auditor independence, conflict of interest, and the unconscious intrusion of bias. Harvard Business School Working Paper #03-116. Retrieved October 7, 2011, from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.9.2829&rep=rep1&type=pdf.
106. Moshman, D. (2011). Adolescent rationality and development: Cognition, morality, and identity. New York, NY: Psychology.
107. Moskowitz, J. M. (1993). Why reports of outcome evaluations are often biased or uninterpretable: Examples from evaluations of drug abuse prevention programs. Evaluation and Program Planning, 16, 1-9. doi:10.1016/0149-7189(93)90032-4.
108. National Research Council Committee on Assessing Integrity in Research Environments. (2002). Integrity in scientific research: Creating an environment that promotes responsible conduct. Washington, DC: National Academies Press.
109. National Research Council Committee on Scientific Principles for Educational Research. (2002). Scientific research in education. Washington, DC: National Academies Press.
110. Oringanje, C., Meremikwu, M. M., Eko, H., Esu, E., Meremikwu, A., & Ehiri, J. E. (2010). Interventions for preventing unintended pregnancies among adolescents. Cochrane Database of Systematic Reviews, 4. doi:10.1002/14651858.CD005215.pub2.
111. Petrosino, A. (2003). Standards for evidence and evidence for standards: The case of school-based drug prevention. Annals of the American Academy of Political and Social Science, 587, 180-207. doi:10.1177/0002716203251218.
112. Rennie, D. (1998). Freedom and responsibility in medical publication: Setting the balance right. Journal of the American Medical Association, 280, 300-302. doi:10.1001/jama.280.3.300.
113. Rennie, D. (1999). Fair conduct and fair reporting of clinical trials. Journal of the American Medical Association, 282, 1766-1768. doi:10.1001/jama.282.18.1766.
114. Reyna, V. F., & Rivers, S. E. (2008). Current theories of risk and rational decision making. Developmental Review, 28, 1-11. doi:10.1016/j.dr.2008.01.002.
115. Rosenthal, R. (1994). Science and ethics in conducting, analyzing, and reporting psychological research. Psychological Science, 5, 127-134. doi:10.1111/j.1467-9280.1994.tb00646.x.
116. Rothwell, P. M. (2005). External validity of randomised controlled trials: "To whom do the results of this trial apply?". The Lancet, 365, 82-93. doi:10.1016/S0140-6736(04)17670-8.
117. Scher, S., Lin, J., & Constantine, N. A. (2009). Motivated translation of ambiguous scientific research findings: A case study from the sex education debates. Paper presented at the International Conference on Science in Society. United Kingdom: University of Cambridge.
118. Scher, L. S., Maynard, R. A., & Stagner, M. (2006). Interventions intended to reduce pregnancy-related outcomes among adolescents. Campbell Collaboration Systematic Reviews, 12. Campbell Collaboration. doi:10.4073/csr.2006.12.
119. Schmidt, F. (2010). Detecting and correcting the lies that data tell. Perspectives on Psychological Science, 5, 233-242. doi:10.1177/1745691610369339.
120. Schneider, S. L., & Shanteau, J. (2003). Emerging perspectives on judgment and decision making. Cambridge, UK: Cambridge University Press.
121. Scientifically Based Evaluation Methods, 68 Fed. Reg. 62,445 (October 29, 2003).
122. Scriven, M. (2008). A summative evaluation of RCT methodology and an alternative approach to causal research. Journal of Multidisciplinary Evaluation, 5, 11-24.
123. Shadish, W. R., Jr., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin.
124. Shafer, G., & Tversky, A. (1985). Languages and designs for probability judgment. Cognitive Science, 9, 309-339. doi:10.1207/s15516709cog0903_2.
125. Shatz, D. (2001). Peer review: A critical inquiry. New York: Rowman and Littlefield.
126. Shavelson, R., & Towne, L. (2004). What drives scientific research in education? Questions, not methods, should drive the enterprise. American Psychological Society Observer, 17(4), 27-30. Retrieved from http://www.psychologicalscience.org/observer/getArticle.cfm?id=1557.
127. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. doi:10.1177/0956797611417632.
128. Slavin, R. E. (1995). Best evidence synthesis: An intelligent alternative to meta-analysis. Journal of Clinical Epidemiology, 48, 9-18. doi:10.1016/0895-4356(94)00097-A.
129. Smith, R., Feachem, R., Feachem, N. S., Koehlmoos, T. P., & Kinlaw, H. (2009). The fallacy of impartiality: Competing interest bias in academic publications. Journal of the Royal Society of Medicine, 102(2), 44-45. doi:10.1258/jrsm.2009.080400.
130. Suellentrop, K. (2010). Effective and promising teen pregnancy prevention programs for Latino youth. Science Says, 43. Retrieved June 6, 2011, from http://www.thenationalcampaign.org/resources/pdf/SS/SS43_TPPProgramsLatinos.pdf.
131. Trenholm, C., Devaney, B., Fortson, K., Clark, M., Quay, L., & Wheeler, J. (2008). Impacts of abstinence education on teen sexual activity, risk of pregnancy, and risk of sexually transmitted diseases. Journal of Policy Analysis and Management, 27, 255-276. doi:10.1002/pam.20324.
132. Trenholm, C., Devaney, B., Fortson, K., Quay, L., Wheeler, J., & Clark, M. (2007). Impacts of four Title V Section 510 abstinence education programs: Final report. Retrieved January 12, 2011, from http://www.mathematica-mpr.com/publications/pdfs/impactabstinence.pdf.
133. Trochim, M. K., & Donnelly, J. P. (2007). The research methods knowledge base (3rd ed.). Mason, OH: Thomson.
134. U.S. Department of Health and Human Services, Office of Adolescent Health. (2010). Overview of the teen pregnancy prevention research evidence review. Retrieved May 16, 2011, from http://www.hhs.gov/ash/oah/prevention/research/index.html.
135. Victora, C. G., Habicht, J., & Bryce, J. (2004). Evidence-based public health: Moving beyond randomized trials. American Journal of Public Health, 94, 400-405.
136. Weersing, V. R., & Weisz, J. R. (2002). Mechanisms of action in youth psychotherapy. Journal of Child Psychology and Psychiatry, 43, 3-29. doi:10.1111/1469-7610.00002.
137. Weiss, C. H. (1980). Social science research and decisionmaking. New York: Columbia University Press.
138. Weiss, C. H., Murphy-Graham, E., Petrosino, A., & Gandhi, A. G. (2008). The fairy godmother- and her warts: Making the dream of evidence-based policy come true. American Journal of Evaluation, 29, 29-47. doi:10.1177/1098214007313742.
139. West, S. G. (2009). Alternatives to randomized experiments. Current Directions in Psychological Science, 18, 299-304. doi:10.1111/j.1467-8721.2009.01656.x.
140. Westen, D., & Bradley, R. (2005). Empirically supported complexity: Rethinking evidence-based practice in psychotherapy. Current Directions in Psychological Science, 14, 266-271. doi:10.1111/j.0963-7214.2005.00378.x.
141. What Works Clearinghouse. (2008). Procedures and standards handbook (Version 2.0). Retrieved June 6, 2011, from http://ies.ed.gov/ncee/wwc/pdf/wwc_procedures_v2_standards_handbook.pdf.
142. Wicherts, J. M., Bakker, M., & Molenaar, D. (2011). Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. Public Library of Science (PLoS) ONE, 6, e26828. doi:10.1371/journal.pone.0026828.
143. Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006). The poor availability of psychological research data for reanalysis. American Psychologist, 61, 726-728.
144. Wiers, R. W., Houben, K., Roefs, A., de Jong, P., Hofmann, W., & Stacy, A. W. (2010). Implicit cognition in health psychology: why common sense goes out of the window. In B. Gawronski & B. K. Payne (Eds.), Handbook of implicit social cognition (pp. 463-488). New York: Guilford.
145. Wilkinson, L., & APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604. doi:10.1037/0003-066X.54.8.594.
146. Williams, P. G., Holmbeck, G. M., & Greenley, R. N. (2002). Adolescent health psychology. Journal of Consulting and Clinical Psychology, 70, 828-842. doi:10.1037/0022-006X.70.3.828.
147. Wolins, L. (1962). Responsibility for raw data. American Psychologist, 17, 657-658. doi:10.1037/h0038819.
148. World Health Organization. (1946). Constitution of the World Health Organization. Retrieved July 28, 2011, from http://apps.who.int/gb/bd/PDF/bd47/EN/constitution-en.pdf.
149. Yin, R. K. (2008). Case study research: Design and methods (4th ed.). Thousand Oaks, CA: Sage.
150. Young, S. N. (2009). Bias in the research literature and conflict of interest: An issue for publishers, editors, reviewers and authors, and it is not just about the money [Editorial]. Journal of Psychiatry & Neuroscience, 34, 412-417.
151. Young, N. S., Ioannidis, J. P. A., & Al-Ubaydi, O. (2009). Why current publication practices may distort science. Public Library of Science (PLoS) Medicine, 5, 1418-1422. doi:10.1371/journal.pmed.0050201.