Validating an evaluation checklist using a mixed method design

Evaluation and Program Planning

Volumn 33, Issue 3, 2010, Pages 215-222

  Martz, Wes ^a  

^a NONE   (United States)

Author keywords

Evaluation checklist; Mixed methods; Organizational evaluation; Validation study

Indexed keywords

METHODOLOGY; ORGANIZATIONAL CHANGE;

ARTICLE; CHECKLIST; HEALTH CARE QUALITY; METHODOLOGY; REPRODUCIBILITY;

CHECKLIST; PROGRAM EVALUATION; REPRODUCIBILITY OF RESULTS;

EID: 77953807802     PISSN: 01497189     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.evalprogplan.2009.10.005     Document Type: Article

References (33)

1. Altschuld J.W., Zheng H.Y. Assessing the effectiveness of research organizations: An examination of multiple approaches. Evaluation Review 1995, 19:197-216.
2. Chang L. A psychometric evaluation of four-point and six-point Likert-type scales in relation to reliability and validity. Applied Psychological Measurement 1994, 18:205-215.
3. Cooksy L.J., Caracelli V.J. Quality, context, and use: Issues in achieving the goals of metaevaluation. American Journal of Evaluation 2005, 26:31-42.
4. Corbin J.M., Strauss A. Basics of qualitative research: Techniques and procedures for developing grounded theory 2008, Sage, Los Angeles. 3rd ed.
5. Coryn, C. L. S. (2007). Evaluation of researchers and their research: Toward making the implicit explicit. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo.
6. Fink A. The survey handbook 2003, Sage, Thousand Oaks, CA. 2nd ed.
7. Greene J.C., Caracelli V.J., Graham W.F. Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis 1989, 11:255-274.
8. Hales B., Terblanche M., Fowler R., Sibbald W. Development of medical checklists for improved quality of patient care. International Journal for Quality in Health Care 2008, 20:22-30.
9. Hales B.M., Pronovost P.J. The checklist: A tool for error management and performance improvement. Journal of Critical Care 2006, 21:231-235.
10. Hsieh H.F., Shannon S.E. Three approaches to qualitative content analysis. Qualitative Health Research 2005, 15:1277-1288.
11. Kalliath T.J., Bluedorn A.C., Gillespie D.F. A confirmatory factor analysis of the competing values instrument. Educational and Psychological Measurement 1999, 59:143-158.
12. Keil M., Li L., Matthiassen L., Zheng G. The influence of checklists and roles on software practitioner risk perception and decision-making. Journal of Systems and Software 2008, 81:908-919.
13. Krippendorff K. Content analysis: An introduction to its methodology 2004, Sage, Thousand Oaks, CA. 2nd ed.
14. Loevinger J. Objective tests as instruments of psychological theory [Monograph Supplement 9]. Psychology Reports 1957, 3:635-694.
15. Martz, W. (2008). Evaluating organizational effectiveness. Dissertation Abstracts International, 69 (07). Publication No. ATT3323530.
16. Messick S. Validity of psychological assessment. American Psychologist 1995, 50:741-749.
17. Owen J.M., Lambert F.C. Evaluation and the information needs of organizational leaders. American Journal of Evaluation 1998, 19:355-365.
18. Papadimitriou D. Conceptualizing effectiveness in a non-profit organizational environment: An exploratory study. International Journal of Public Sector Management 2007, 20:571-587.
19. Persaud, N. (2007). Conceptual and practical analysis of costs and benefits: Developing a cost-analysis tool for practical program evaluation. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo.
20. Quinn R.E., Rohrbaugh J. A competing values approach to organizational effectiveness. Public Productivity Review 1981, 2:122-140.
21. Quinn R.E., Rohrbaugh J. A spatial model of effectiveness criteria: Towards a competing values approach to organizational analysis. Management Science 1983, 29:363-377.
22. Quinn R.E., Spreitzer G.M. The psychometrics of the competing values culture instrument and an analysis of the impact of organizational culture on quality of life. Research in Organizational Change and Development 1991, 5:114-142.
23. Ridley C.R., Mendoza D.W. Putting organizational effectiveness into practice: The preeminent consultation task. Journal of Counseling and Development 1993, 72:168-178.
24. Sanders J.R. A vision for evaluation. American Journal of Evaluation 2001, 22:363-366.
25. Schroeter, D. C. (2008). Sustainability evaluation: Development and validation of an evaluation checklist. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo.
26. Schweigert F.J. The meaning of effectiveness in assessing community initiatives. American Journal of Evaluation 2006, 27:416-436.
27. Scriven M. The final synthesis. Evaluation Practice 1994, 15:367-382.
28. Scriven M. Checklists. Encyclopedia of evaluation 2005, 53-59. Sage, Thousand Oaks, CA. S. Mathison (Ed.).
29. Scriven, M. (2007). The logic and methodology of checklists. Retrieved December 30, 2007 from http://www.wmich.edu/evalctr/checklists/papers/logic%26methodology_dec07.pdf.
30. Stufflebeam, D. L. (2000) Guidelines for developing evaluation checklists: The checklist development checklist. Retrieved April 22, 2007 from http://www.wmich.edu/evalctr/checklists/guidelines_cdc.pdf.
31. Stufflebeam D.L. Evaluation checklists: Practical tools for guiding and judging evaluations. American Journal of Evaluation 2001, 22:71-79.
32. Stufflebeam D.L., Shinkfield A.J. Evaluation theory, models, and applications 2007, Jossey-Bass, San Francisco.
33. Yin R.K. Case study research: Design and methods 2009, Sage, Thousand Oaks, CA. 4th ed.