Lessons learned about evaluation in the United States and some possible implications for Europe

European Journal of Psychological Assessment

Volumn 14, Issue 2, 1998, Pages 97-115

  Cook, Thomas D ^a   Wittmann, Werner W ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b UNIVERSITY OF MANNHEIM   (Germany)

Author keywords

Evaluation; Evaluation culture; Ex post and ex ante research; Literature reviews; Organization of research; Politics of research; Qualitative and quantitative methods

Indexed keywords

EID: 3042939272     PISSN: 10155759     EISSN: None     Source Type: Journal    
DOI: 10.1027/1015-5759.14.2.97     Document Type: Review

References (50)

1. Ahlenius, I.-B. (1997). Auditing and evaluation in Sweden. In E. Chelimsky & W. R. Shadish (Eds.), Evaluation for the 21st century: A handbook. Thousand Oaks, CA: Sage.
2. Blank, R. M. (1997) It takes a nation. Princeton, NJ: Princeton University Press.
3. Brooks, R. A. (1997). Evaluation and auditing in state legislatures: Meeting the client's needs. In E. Chelimsky & W. R. Shadish (Eds.), Evaluation for the 21st century: A handbook. Thousand Oaks, CA: Sage.
4. Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park: Sage.
5. Bussmann, W., Klöti, U., & Knoepfel, P. (1997). Einführung in die Politikevaluation. Basel: Helbing und Lichtenhahn.
6. Campbell, D. T. (1974). Qualitative knowing in action research. Kurt Lewin Award Address, Society for the Psychological Study of Social Issues, presented at the 82nd annual meeting of the American Psychological Association, New Orleans.
7. Campbell, D. T. (1978). Qualitative knowing in action research. In M. Brenner, P. Marsh, & M. Brenner (Eds.), The social context of methods. London: Croom Helm.
8. Campbell, D. T. (1986). Science's social system of validityenhancing collective belief change and the problems of the social sciences. In D. W. Fiske & R. S. Shweder (Eds.), Metatheory in social science: Pluralisms and subjectivities. Chicago: University of Chicago Press.
9. Chelimsky, E. (1985). Comparing and contrasting auditing and evaluation: Some notes on their relationship. Evaluation Review, 9, pp. 485-503.
10. Chelimsky, E. (1987). The politics of program evaluation. In D.S. Cordray, H.S. Bloom, & R.J. Light (Eds.), Evaluation practice in review. San Francisco: Jossey-Bass.
11. Chelimsky, E., & Shadish, W. R. (1997). Evaluation for the 21st century: A handbook. Thousand Oaks, CA: Sage.
12. Cicirelli, V. G., & Associates (1969). The impact of Head Start: An evaluation of the effects of Head Start on children's cognitive and affective development (Report to the Office of Economic Opportunity, 2 Vols.). Athens: Ohio University and Westinghouse Learning Corporation.
13. Cook, T. D., & Reichart, C. S. (Eds.). (1979). Qualitative and quantitative methods in evaluation research. Beverly Hills, CA: Sage.
14. Cook, T. D. (1985). Postpositivist critical multiplism. In L. Shotland & M. M. Mark (Eds.), Social science and social policy. Beverly Hills, CA: Sage.
15. Cook, T. D. (1993). A quasi-sampling theory of the generalization of causal relationships. In L. Sechrest & A. G. Scott (Eds.), New directions for program evaluation: Understanding causes and generalizing about them (Vol.57). San Francisco: Jossey-Bass.
16. Cook, T. D., Cooper, H., Cordray, D. S., Hartmann, H., Hedges, L. V., Light, R. J., Louis, T. A., & Mosteller, F. (1992). Meta-analysis for explanation: A casebook. New York: Russell Sage Foundation.
17. Cooper, H., & Hedges, L. V. (Eds.). (1994). The handbook of research synthesis. New York: Russell Sage Foundation.
18. Cronbach, L. (1980). Toward reform of program evaluation. San Francisco: Jossey-Bass.
19. Cronbach, L. (1982). Designing evaluations of educational and social programs. San Francisco: Jossey-Bass.
20. Dryfoos, J. (1990). Adolescents at risk: Prèvalence and prevention. New York: Oxford University Press.
21. Fetterman, D. M. (1996). Empowerment evaluation: An introduction to theory and practice. In Fetterman, D.M., Kaftarian, S., & Wandersman, A. (1995). Empowerment evaluation: Knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage.
22. Fernandez Ballesteros, R. (1996). Evaluability assessment and policy cycle: Measuring evaluability. In CEDEFOP (Ed.), Evaluation of European training, employment and human resources programmes (pp. 75-81). Thessaloniki: European Centre for Development of Vocational Training.
23. Fernandez-Ballesteros, R., Vedung, E., & Seyfried, E. (in press). Psychology in program evaluation. European Psychologist.
24. Grawe, K., Donati, R., & Bernauer, F. (1994). Psychotherapie im Wandel (3. Aufl.). Göttingen: Hogrefe.
25. Guba, E. G., & Lincoln, Y. S. (1981). Effective evaluation: Improving the usefulness of evaluation results through responsive and naturalistic approaches. San Francisco: Jossey-Bass.
26. Guba, E. G., & Lincoln, Y. S. (1989). Fourth generation evaluation. Newbury Park, CA: Sage.
27. Hammond, K. R. (1996). Human judgment and social policy. Oxford/New York: Oxford University Press.
28. Heap, J. L. (1995) Constructionism in the rhetoric and practice of fourth generation evaluation. Evaluation of Progress and Planning, 18, 51-61.
29. House, E. R. (1991). Evaluation and social justice: Where are we? In M. W. McLaughlin & D. C. Phillips (Eds.), Evaluation and education: At quarter century (pp. 233-247). Chicago: University of Chicago Press.
30. Jencks, C., & Mayer, S. (1990). The social consequences of growing up in a poor neighborhood. In L. E. Lynn & M. McGeary (Eds.), Inner city poverty in the United States. Washington, D. C.: National Academy Press.
31. Jessor, R. A., Colby, A., & Schweder (Eds.). (1996). Ethnography and human development. Chicago: University of Chicago Press.
32. Leviton, L. C., & Cook, T. D. (1983). Evaluation findings in education and social work textbooks. Evaluation Review, 7,497-518.
33. Light, R. J., & Pillemer, D. B. (1984). Summing up: The science of reviewing research. Cambridge, MA: Harvard University Press.
34. Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48(12), 1181-1209.
35. Lipton, D., Martinson, & Wilks, J. (1975). The effectiveness of correctional treatment - a survey of treatment evaluation studies. New York: Praeger.
36. Matt, G. E., & Cook, T. D. (1993). The war on fraud and error in the food stamp program: An evaluation of its effects in the Carter and Reagan administrations. Evaluation Review, 17, 503-520.
37. Navarro, A. M. (1990). Eficacia de las terapias psicologicas: Meta-analisis de estudios en paises de habla hispana [Effectiveness of psychological therapies: Metaanalysis of outcome studies in Spanish-speaking countries]. Revista de Psicologia Social y Personalidad, 6, 87-99.
38. Pawson, R., & Tully, N. (1997). An introduction to scientific realist evaluation. In E. Chelimsky & W. R. Shadish (Eds.), Evaluation for the 21st century: A handbook. Thousand Oaks, CA: Sage.
39. Patton, M. Q. (1980). Qualitative evaluation methods. Beverly Hills, CA: Sage.
40. Pollitt, C., & Summa H. (1997). Performance auditing: Travelers' tales. In E. Chelimsky & W. R. Shadish (Eds.), Evaluation for the 21st century: A handbook. Thousand Oaks, CA: Sage.
41. Pollitt, C. (1997). A note on Elliot Stern's proposal. Newsletter from the European Evaluation Society, No. 1/97.
42. Pratley, A. (1995). Auditing, financial management and evaluation: An interview with Alan Pratley. Evaluation, 1(2), 251-263.
43. Rossi, P. H. (1966). Boobytraps and pitfalls in the evaluation of social action programs. Proceedings of the Social Statistics Section, American Statistical Association. Washington, DC: American Statistical Association.
44. Schorr, L. B., with D. Schorr (1988). Within our reach. Breaking the cycle of disadvantage. New York: Anchor Press, Doubleday.
45. Shadish, W. R. (1995). Philosophy of science and the quantitative-qualitative debates: 13 common errors. Evaluation of Progress and Planning, 18, 63-75.
46. Shadish, W. R., Cook, T. D., & Leviton, L. C. (1991). Foundations of program evaluation. Newbury Park, CA: Sage.
47. Stake, R. E. (1980). Program evaluation, particularly responsive evaluation. In W. B. Dockrell, & D. Hamilton (Eds.), Rethinking educational research. London: Hodder & Stoughton.
48. Suchman, E. (1967). Evaluation research. New York: Russell Sage Foundation.
49. Watts, H. W., & Rees, A. (1977). Labor supply responses. The New Jersey income maintenance experiment (Vol. 2). New York: Academic Press.
50. Wittmann, W. W., & Matt, G. E. (1986). Meta-Analyse als Integration von Forschungersgebnissen am Beispiel deutschsprachiger Arbeiten zur Effektivität von Psychotherapie. Psychologische Rundschau, 37, 20-40.