Maximizing both external and internal validity in longitudinal true experiments with voluntary treatments: The "combined modified" design

Evaluation and Program Planning

Volumn 19, Issue 4, 1996, Pages 287-300

  Braver, Sanford L ^a   Smith, Melanie C ^b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0013254148     PISSN: 01497189     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0149-7189(96)00029-8     Document Type: Article

References (70)

1. AIKEN, L.S., STEIN, J.A., & BENTLER, P.M. (1994). Structural equation analyses of clinical subpopulation differences and comparative treatment outcomes: Characterizing the daily lives of drug addicts (Special section: Structural equation modeling in clinical psychology). Journal of Consulting and Clinical Psychology, 62, 488-500.
2. ALBERT, J.M., & DEMETES, D.L. (1994). On a model-based approach to estimating efficacy in clinical trials. Statistics in Medicine, 13, 2323-2335.
3. ALLEN, N.L., & HOLLAND, P.W. (1989). Exposing our ignorance: The only "solution" to selection bias. Journal of Educational Statistics, 14, 141-145.
4. APPLETON, D.R. (1995). What do we mean by statistical model? Statistics in Medicine, 14, 185-197.
5. ASTIN, A.W., & MOLM, L.D. (1972). Correcting for nonresponse bias in follow-up surveys. (Available from the Office of Research of the American Council on Education, 1 Dupont Circle, Washington, DC).
6. BERK, R.A. (1983). An introduction to sample selection bias in sociological data. American Sociological Review, 48, 386-398.
7. BERK, R.A., & SHERMAN, L.W. (1988). Police response to family violence incidents: An analysis of an experimental design with incomplete randomization. Journal of the American Statistical Association, 83, 70-76.
8. BEUHLER, C., BETZ, P., RYAN, C.M., LEGG, B.H., & TROTTER, B.B. (1992). Description and evaluation of the Orientation for Divorcing Parents: Implications for postdivorce prevention programs. Family Relations, 41, 154-162.
9. BIGLAN, A., SEVERSON, H., ARY, D., FALLER, C., GALLISON, C., THOMPSON, R., GLASGOW, R., & LICHTENSTEIN, E. (1987). Do smoking prevention programs really work? Attrition and the internal validity of an evaluation of a refusal skills training program. Journal of Behavioral Medicine, 10, 159-171.
10. BIRNBAUM, M.H., & MELLERS, B.A. (1989). Mediated models for the analysis of confounded variables and self-selected samples. Journal of Educational Statistics, 14, 146-158.
11. BLAKELY, C.H., MAYER. J.P., GOTTSCHALK, R.G., SCHMIDT, N.M., DAVIDSON, W.S., ROITMAN. D.B., & EMSHOFF, J.G. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253-268.
12. BLOOM, H.S. (1984). Accounting for no-shows in experimental evaluation designs. Evaluation Review, 8, 225-246.
13. BRAVER, S.L. (1993). From efficacy to effectiveness: Who participates in research trials. Paper presented at NIMH-PIRC Symposium, Tempe, AZ.
14. BREWER, M.B. (1976). Randomized invitations: One solution to the problem of voluntary treatment selection in program evaluation research. Social Science Research, 5, 315-323.
15. CAMPBELL, D.T. (1987). Guidelines for monitoring the scientific competence of preventive research centers: An exercise in the sociology of scientific validity. Knowledge: Creation, Diffusion, Utilization, 8, 389-430.
16. CAMPBELL, D.T., & STANLEY, J.C. (1963). Experimental and quasi-experimental designs for research on teaching. Boston: Houghton Mifflin.
17. CASSEL, C.M., SARNDAL, C.E., & WRETMAN, J.H. (1983). Some uses of statistical models in connections with the nonresponse problem. In W. A. Madow & I. Olkin (Eds), Symposium on Incomplete Data, Vol. 3: Incomplete data in sample surveys. New York: Academic Press.
18. CHAPMAN, D.W. (1974). An investigation of non-response imputation procedures for the Health and Nutrition Examination Survey. Prepared for the Division of Health Examinations Statistics, National Center for Health Statistics, HEW, by Westat.
19. COHEN, J. (1977). Statistical power analysis for the behavioral sciences. New York: Academic Press.
20. COOK, T.D. (1993). A quasi-sampling theory of the generalization of causal relationships. In L. B. Sechrest & A. G. Scott (Eds.), Understanding causes and generalizing about them (pp. 39-82). San Francisco: Jossey Bass.
21. COOK, T.D., & CAMPBELL, D.T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton-Mifflin.
22. COOK, T.D., LEVITON, L.C., & SHADISH, W.R. Jr (1985). Program evaluation. In G. Lindzey & E. Aronson (Eds.), The handbook of social psychology (3rd ed.). New York: Random House.
23. DELUCCHI, K.L. (1994). Methods for the analysis of binary outcome results in the presence of missing data. Journal of Clinical and Consulting Psychology, 62, 569-575.
24. DELUSÉ, S.R., BRAVER, S.L., & SANDLER, I.N. (1995). Who volunteers for programs to help their children: A test of a recruitment method and a theoretical extension. Poster presented at the Society for Community Research and Action, Chicago, IL, June.
25. DENNIS, M.L. (1994). Ethical and practical randomized field experiments. In J. S. Wholey, H. Hatry & K. Newcomer (Eds.), Handbook of practical program evaluation (pp. 155-197). San Francisco: Jossey-Bass.
26. DENNIS, M.L., FETTERMAN, D., & SECHREST, L. (1994). Integrating qualitative and quantitative evaluation methods in substance abuse research. Evaluation and Program Planning, 17, 419-427.
27. DUNCAN, T.E., OMAN, R., & DUNCAN. S.C. (1994). Modeling incomplete data in exercise behavior research using structural equation methodology. Journal of Sport and Exercise Psychology, 16, 187-203.
28. ELLENBERG, J.H. (1994). Selection bias in observational and experimental studies. Statistics in Medicine, 13, 557-567.
29. FRANK, R.G., SCHULBERG, H.C., WELCH, W.P., SHERICK, H., & COSTELLO, A.J. (1985). Research selection bias and the prevalence of depressive disorders in psychiatric facilities. Journal of Consulting and Clinical Psychology, 53, 370-376.
30. GARVIN, V., LEBER. D., & KALTER, N. (1991). Children of divorce: Predictors of change following preventive intervention. American Journal of Orthopsychiatry, 61, 438-447.
31. HANSEN, W.B., COLLINS, L.M., MALOTTE, C.K., JOHNSON, C.A., & FIELDING, J.E. (1985). Attrition in prevention research. Journal of Behavioral Medicine, 8, 261-275.
32. HECKMAN, J.J. (1979). Sample selection bias as a specification error. Economertica, 47, 153-161.
33. HECKMAN, J.J. (1980). Sample selection bias as a specification error. In J. P. Smith (Ed.), Female labor supply: Theory and estimation (pp. 206-248). Princeton: Princeton University Press.
34. HECKMAN, J.J. (1989). Causal inference and nonrandom samples. Journal of Educational Statistics, 14, 159-168.
35. HOLMES, P. (1983). "Dropping out" from an adolescent therapeutic group: A study of factors in the patients and their parents which influence this process. Journal of Adolescence, 6, 333-346.
36. HOWARD, J. (1987). Using mammography for cancer control: An unrealized potential. A Cancer Journal for Clinicians, 37, 33-48.
37. HOWARD, K.I., KRAUSE, M.S., & ORLINSKY, D.E. (1986). The attrition dilemma: Toward a new strategy for psychotherapy research. Journal of Consulting and Clinical Psychology, 54, 106-110.
38. JURS, S.G., & GLASS, G.V. (1971). The effect of experimental mortality on the internal and external validity of the randomized comparative experiment. Journal of Experimental Education, 40, 62-66.
39. LIPSEY, M.W. (1988). Practice and malpractice in evaluation research. Evaluation Practice, 9, 5-24.
40. LIPSEY, M.W. (1990). Design sensitivity: Statistical power for experimental research. Newbury Park, CA: Sage.
41. LIPSEY, M.W., CROSSE, S., DUNKLE, J., POLLARD, J., & STOBART, G. (1985). Evaluation: The state of the art and the sorry state of science. New Directions for Program Evaluation, 27, 7-28.
42. LIPSEY, M.W., & WILSON, D.B. (1991). The efficacy of psychological, educational, and behavioral treatments: Confirmation from meta-analysis. American Psychologist, 48, 1181-1210.
43. LITTLE, R.J.A., & RUBIN, D.B. (1990). Statistical analysis with missing data (2nd ed.), New York: Wiley.
44. LOHR, S (in press). Sample surveys: Design and analysis. Belmont, CA: Duxbury Press.
45. LORION, R.P., PRICE, R.H., & EATON, W.W. (1989). The prevention of child and adolescent disorders: From theory to research. In D. Schaffer, I. Philips & N. B. Enzer (Eds.), Prevention of mental disorders, alcohol, and other drug use in children and adolescents. Office of Substance Abuse Prevention Monograph-2, (DHHS Publication No. ADM 90-1646). Washington, DC: U.S. Government Printing Office.
46. MANSKI, C.F. (1993). Identification problems in the social sciences. Sociological Methodology, 27, 1-56.
47. MAYER, J.P., & DAVIDSON, W.S. (in press). Dissemination of innovations. In J. Rappaport & E. Seidman (Eds.). The handbook of community psychology. New York: Plenum Press.
48. MORGENSTERN, H., & BURSIC, E.S. (1982). A method for using epidemiological data to estimate the potential impact of an intervention on the health status of a target population. Journal of Community Health, 7, 292-309.
49. MORRIS, C.N., NEWHOUSE, J.P., & ARCHIBALD, R.A. (1980). On the theory and practice of obtaining unbiased and efficient samples in social surveys. Evaluation Studies Review Annual, 5, 99-143.
50. MOSKOWITZ, J.M. (1993). Why reports of outcome evaluations are often biased or uninterpretable: Examples from evaluations of drug abuse prevention programs. Evaluation and Program Planning, 16, 1-9.
51. RIECKEN, H.W., & BORUCH, R.F. (Eds.), (1974). Social experimentation: A method for planning and evaluating social intervention. New York: Academic Press.
52. ROBLES, N., FLAHERTY, D.G., & DAY, N.L. (1994). Retention of resistant subjects in longitudinal studies: Description and procedures. American Journal of Drug and Alcohol Abuse, 20, 87-100.
53. RUBIN, D. B. (1987). Multiple imputation for nonresponse in surveys. New York: John Wiley.
54. RUBIN, D.B. (1991). EM and beyond. Psychometrika, 56, 241-254.
55. SAMEROFF, A.J., & FIESE, B.H. (1989). Conceptual issues in prevention. In D. Schaffer, I. Philips & N. B. Enzer (Eds.), Prevention of mental disorders, alcohol, and other drug use in children and adolescents. Office of Substance Abuse Prevention Monograph-2, (DHHS Publication No. ADM 90-1646, pp. 23-52). Washington, DC: U.S. Government Printing Office.
56. SANDLER, I.N., ROOSA, M.W., WOLCHIK, S.A., WEST, S.G., BRAVER, S.L., ZAUTRA, A.J., MILLER, P.A., KNIGHT, G.P., WESCHLER, L.F., & GRIFFIN, W. (1989). Center for the Prevention of Child and Family Stress. (Grant proposal).
57. SEIDMAN, E. (1988). Back to the future, community psychology: Unfolding a theory of social intervention. American Journal of Community Psychology, 16, 3-24.
58. STEIN, R.E.K., BAUMAN, L.J., & IREYS, H.T. (1991). Who enrolls in prevention trials? Discordance in perception of risk professionals and participants. American Journal of Community Psychology. 19, 603-617.
59. STEUER, J.L., MINTZ, J., HAMMEN, C.L., HILL, M.A., JARVIK, L.F., MCCARLEY, T., MOTOIKE, P., & ROSEN, R. (1984). Cognitive-behavioral and psychodynamic group therapy in treatment of geriatric depression. Journal of Consulting and Clinical Psychology, 52, 180-189.
60. STOLBERG, A.L., & GARRISON, K.M. (1985). Evaluating a primary program for children of divorce. American Journal of Community Psychology, 13, 111-124.
61. TJADEN, A.E., GORDON, D.A., & ARBUTHNOT, J. (submitted). Pediatricians use of a divorce-stress reduction program.
62. VACH, W., & BLETTNER, M. (1995). Logistic regression with incompletely observed categorical covariates: Investigating the sensitivity against violation of the missing at random assumption. Statistics in Medicine, 14, 1315-1329.
63. VINOKUR, A.D., PRICE, R.H., & CAPLAN, R.D. (1991). From field experiments to program implementation: Assessing the potential outcomes of an experimental intervention program for unemployed persons. American Journal of Community Psychology, 19, 543-562.
64. WAINER, H. (1989). Eelworms, bullet holes, and Geraldine Ferraro: Some problems with statistical adjustment and some solutions. Journal of Educational Statistics, 14, 121-140.
65. WALLACE, L.P. (1987). The Community Penalties Act of 1983: An evaluation of the law, its implementation, and its impact on North Carolina. (Doctoral dissertation, University of Nebraska. 1987). Dissertation Abstracts International, 48-05B, 1551.
66. WARREN, N.J., & AMARA, I.A. (1984). Educational groups for single parents: The parenting after divorce programs. Journal of Divorce, 8, 79-96.
67. WEISS, D.J. (1987). Dropout in patient compliance studies: A suggested analytic procedure. Journal of Compliance in Health Care, 2, 73-83.
68. WEST, S.G., AIKEN, L.S., & TODD, M. (1993). Probing the effects of individual components in multiple component prevention programs. American Journal of Community Psychology, 21, 571-605.
69. WOLCHIK, S.A., WEST, S.G., WESTOVER, S., SANDLER, I.N., MARTIN, A., LUSTIG, J., TEIN, J.Y., & FISHER, J. (1993). The children of divorce parenting intervention: Outcome evaluation of an empirically based program. American Journal of Community Psychology, 2, 293-332.
70. WORTMAN, C.B., HENDRICKS, M., & HILLIS, J.W. (1976). Factors affecting participant reactions to random assignment in ameliorative social programs. Journal of Personality and Social Psychology, 33, 256-266.