Revisiting the retrospective pretest

American Journal of Evaluation

Volumn 26, Issue 4, 2005, Pages 501-517

  Hill, Laura Griner ^a   Betz, Drew L ^a  

^a WASHINGTON STATE UNIVERSITY   (United States)

Author keywords

Bias; Change scores; Pretest; Retrospective pretest

Indexed keywords

EID: 28844479700     PISSN: 10982140     EISSN: None     Source Type: Journal    
DOI: 10.1177/1098214005281356     Document Type: Review

References (46)

1. Aiken, L. S., & West, S. G. (1990). Invalidity of true experiments: Self-report pretest biases. Evaluation Review, 14(4), 374-390.
2. Aronson, E., & Mills, J. (1959). The effect of severity of initiation on liking for a group. Journal of Abnormal and Social Psychology, 59, 177-181.
3. Beauvois, J.-L.O., & Joule, R.-V. (1996). A radical dissonance theory. Philadelphia: Taylor & Francis.
4. Bradley, S. J., Jadaa, D.-A., Brody, J., Landy, S., Tallett, S. E., Watson, W., et al. (2003). Brief psychoeducational parenting program: An evaluation and 1-year follow-up. Journal of the American Academy of Child & Adolescent Psychiatry, 42(10), 1171-1178.
5. Bray, J. H., & Howard, G. S. (1980). Methodological considerations in the evaluation of a teacher-training program. Journal of Educational Psychology, 72(1), 62-70.
6. Campbell, D. T., Stanley, J. C., & Gage, N. L. (1963). Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.
7. Campbell, J. D., & Tesser, A. (1983). Motivational interpretations of hindsight bias: An individual difference analysis. Journal of Personality, 51(4), 605-620.
8. Christianson, S., & Safer, M. A. (1996). Emotional events and emotions in autobiographical memories. In D. C. Rubin (Ed.), Remembering ourpast: Studies in autobiographical memory (pp. 218-243). New York: Cambridge University Press.
9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
10. Cooke, B. (1998). Beyond basic training. Evaluation Exchange, 4, 8-9.
11. Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24, 349-354.
12. Davis, G. A. (2003). Using a retrospective pre-post questionnaire to determine program impact. Journal of Extension, 41. Retrieved May 15, 2004, from http://www.joe.org
13. Festinger, L. (1957). A theory of cognitive dissonance. Oxford, UK: Row, Peterson.
14. Fisher, R. J., & Katz, J. E. (2000). Social-desirability bias and the validity of self-reported values. Psychology & Marketing, 17(2), 105-120.
15. Gilovich, T., Griffin, D., & Kahneman, D. (2002). Heuristics and biases: The psychology of intuitive judgment. New York: Cambridge University Press.
16. Henry, B., Moffitt, T. E., Caspi, A., Langley, J., & Silva, P. A. (1994). On the "remembrance of things past": A longitudinal evaluation of the retrospective method. Psychological Assessment, 6(2), 92-101.
17. Howard, G. S., & Dailey, P. R. (1979). Response-shift bias: A source of contamination of self-report measures. Journal of Applied Psychology, 64(2), 144-150.
18. Howard, G. S., Dailey, P. R., & Gulanick, N. A. (1979). The feasibility of informed pretests in attenuating response-shift bias. Applied Psychological Measurement, 3(4), 481-494.
19. King, M. F., & Bruner, G. C. (2000). Social desirability bias: A neglected aspect of validity testing. Psychology & Marketing, 17(2), 79-103.
20. Kumpfer, K., Alvarado, R., & Whiteside, H. O. (2003). Family interventions for substance use and misuse prevention. Substance Use and Misuse, 38, 1759-1787.
21. Lam, T.C. M., & Bengo, P. (2003). A comparison of three retrospective self-reporting methods of measuring change in instructional practice. American Journal of Evaluation, 24, 65-80.
22. Lipsey., M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
23. MacLeod, J., & Nelson, G. (2000). Programs for the promotion of family wellness and the prevention of child maltreatment: A meta-analytic review. Child Abuse & Neglect, 24(9), 1127-1149.
24. Magnuson, K. A., & Duncan, G. J. (2004). Parent- versus child-based intervention strategies for promoting children's well-being. In A. Kalil & T. DeLeire (Eds.), Family investments in children's potential: Resources and parenting behaviors that promote success (pp. 209-235). Mahwah, NJ: Lawrence Erlbaum.
25. Molgaard, V. K., Kumpfer, K., & Fleming, E. (n.d.). Strengthening Families Program for Parents and Youth 10- 14: A video based curriculum (leader guide). Ames: Iowa State University Extension.
26. Myers-Walls, J. A. (2000). An odd couple with promise: Researchers and practitioners in evaluation settings. Family Relations: Interdisciplinary Journal of Applied Family Studies, 49, 341-347.
27. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84(3), 231-259.
28. Norman, G. (2003). Hi! How are you? Response shift, implicit theories and differing epistemologies. Quality of Life Research, 12(3), 239-249.
29. Paulhus, D. L. (2002). Socially desirable responding: The evolution of a construct. In H. I. Braun & D. N. Jackson (Eds.), The role of constructs in psychological and educational measurement (pp. 49-69). Mahwah, NJ: Lawrence Erlbaum.
30. Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000). Measuring program outcomes: Using retrospective pretest methodology. American Journal of Evaluation, 21, 341-349.
31. Redmond, C., Spoth, R., Shin, C., & Lepper, H. S. (1999). Modeling long-term parent outcomes of two universal family focused preventive interventions: One-year follow-up results. Journal of Consulting & Clinical Psychology, 67(6), 975-984.
32. Ross, M. (1989). Relation of implicit theories to the construction of personal histories. Psychological Review, 96(2), 341-357.
33. Schwartz, C. E., & Rapkin, B. D. (2004). Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal. Health Quality Life Outcomes, 2(1), 16.
34. Schwartz, C. E., & Sprangers, M. A. (1999). Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science and Medicine, 48(11), 1531-1548.
35. Schwartz, C. E., Sprangers, M. A. G., Carey, A., & Reed, G. (2004). Exploring response shift in longitudinal data. Psychology and Health, 19, 51-69.
36. Schwarz, N., & Clore, G. L. (1985). Mood information: 20 years later. Psychological Inquiry, 14, 196-303.
37. Schwarz, N., Hippler, H.-J., Deutsch, B., & Strack, F. (1985). Response scales: Effects of category range on reported behavior and comparative judgments. Public Opinion Quarterly, 49, 388-395.
38. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
39. Spoth, R., Guyll, M., Chao, W., & Molgaard, V. (2003). Exploratory study of a preventive intervention with general population African American families. Journal of Early Adolescence, 23, 435-468.
40. Spoth, R., Redmond, C., & Shin, C. (1998). Direct and indirect latent-variable parenting outcomes of two universal family-focused preventive interventions: Extending a public health-oriented research base. Journal of Consulting & Clinical Psychology, 66(2), 385-399.
41. Sprangers, M. (1989). Subject bias and the retrospective pretest in retrospect. Bulletin of the Psychonomic Society, 27(1), 11-14.
42. Sprangers, M. A., & Schwartz, C. E. (1999). Integrating response shift into health-related quality of life research: A theoretical model. Social Science and Medicine, 48(11), 1507-1515.
43. Tedeschi, J. T., Schlenker, B. R., & Bonoma, T. V. (1971). Cognitive dissonance: Private ratiocination or public spectacle? American Psychologist, 26, 685-695.
44. Tolan, P. H., Hanish, L. D., McKay, M. M., & Dickey, M. H. (2002). Evaluating process in child and family interventions: Aggression prevention as an example. Journal of Family Psychology, 16(2), 220-236.
45. Webster-Stratton, C., Reid, M. J., & Hammond, M. (2004). Treating children with early-onset conduct problems: Intervention outcomes for parent, child, and teacher training. Journal of Clinical Child & Adolescent Psychology, 33(1), 105-124.
46. Wilson, A. E., & Ross, M. (2001). From chump to champ: People's appraisals of their earlier and present selves. Journal of Personality & Social Psychology, 80(4), 572-584.