Content Validity Using a Mixed Methods Approach: Its Application and Development Through the Use of a Table of Specifications Methodology

Journal of Mixed Methods Research

Volumn 7, Issue 3, 2013, Pages 243-260

  Newman, Isadore ^a   Lim, Janine ^b   Pineda, Fernanda ^a  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

^b ANDREWS UNIVERSITY   (United States)

Author keywords

content validity; Table of Specifications

Indexed keywords

EID: 84879045274     PISSN: 15586898     EISSN: 15586901     Source Type: Journal    
DOI: 10.1177/1558689813476922     Document Type: Article

References (52)

1. Ary D.,Jacobs L.,Razavieh A.Introduction to research in education. 2005). Introduction to research in education (7th ed.). New York, NY: Wadsworth.New York, NY: Wadsworth; 2005:.
2. Beggs D.,Lewis E.Measurement and evaluation in the schools. Boston, MA: Houghton Mifflin; 1975:.
3. Bloom B. S.Taxonomy of educational objectives: The classification of educational goals. New York, NY: David McKay; 1956:.
4. Brod M.,Tesler L.,Christensen T.Qualitative research and content validity: Developing best practices based on science and experience.Quality of Life Research. 2009;18:1263-1278.
5. Bryant A.,Charmaz K.The Sage handbook of grounded theory. Bryant A.Charmaz K., ed. Los Angeles, CA: Sage; 2007:31-74.
6. Carmines E. G.,Zeller R. A.Reliability and validity assessment. Newbury Park, CA: Sage; 1991:.
7. Ceglowski D. A. Aced out: Censorship of qualitative research in the age of scientifically based research. Paper presented at the annual meeting of the American Educational Research Association; 2012Vancouver, British Columbia, Canada; 2012.
8. Christ T. W. Policy, scientifically based research, and randomized control trials: The gold standard?Paper presented at the annual meeting of the American Educational Research Association; 2012Vancouver, British Columbia, Canada; 2012.
9. Cook T. D.Why have educational evaluators chosen not to do randomized experiments?.Annals of the American Academy of Political and Social Science. 2003;589:114-149.
10. Cronbach L. J.Essentials of psychological testing. 1970). Essentials of psychological testing (3rd ed.). New York, NY: Harper & Row.New York, NY: Harper & Row; 1970:.
11. Cronbach L. J.Educational measurement. 1971). Test validation. In ThorndikeR. L. (Ed.), Educational measurement (2nd ed., pp. 443-507). Washington, DC: American Council on Education.Thorndike R. L., ed. Washington, DC: American Council on Education; 1971:443-507.
12. Cullen A.,Coryn C.,Rugh J.The politics and consequences of including stakeholders in international development evaluation.American Journal of Evaluation. 2011;32:345-361.
13. DaltonD. (2006). Educational research: The gold standard? Retrieved from http://specialed.wordpress.com/2006/02/10/educational-researchthe-gold-standard.
14. Darling-Hammond L.,Youngs P.Defining highly qualified teachers: What does scientifically-based research actually tell us?.Educational Researcher. 2002;31:13-25.
15. Denzin N.,Lincoln Y.Handbook of qualitative research. Thousand Oaks, CA: Sage; 1994:.
16. FagerJ. (n.d.). Designing a test: Developing a table of specifications. Retrieved from http://www.cmich.edu/about/leadership/office_provost/AcademicAffairs/CAA/Documents/TableofSpecifications.pdf.
17. Glaser B.,Strauss A.The discovery of grounded theory: Strategies for qualitative research. Chicago, IL: Aldine; 1967:.
18. Guion R.Content validity: The source of my discontent.Applied Psychological Measurement. 1977;1:1-10.
19. Haynes S. N.,Richard D. C. S.,Kubany E. S.Content validity in psychological assessment: A functional approach to concepts and methods.Psychological Assessment. 1995;7:238-247.
20. Hubley A. M.,Zumbo B. D.Validity and the consequences of test interpretation and use.Social Indicators Research. 2011;103:219-230.
21. Johnson B.,Christensen L.Educational research: Quantitative, qualitative, and mixed approaches. 2004). Educational research: Quantitative, qualitative, and mixed approaches (2nd ed.). New York, NY: Pearson.New York, NY: Pearson; 2004:.
22. Kerlinger F. N.,Lee H. B.Foundations of behavioral research. 2000). Foundations of behavioral research (4th ed.). Fort Worth, TX: Harcourt College.Fort Worth, TX: Harcourt College; 2000:.
23. Krathwohl D. R.Methods of educational and social science research: The logic of methods. 2009). Methods of educational and social science research: The logic of methods (3rd ed.). Long Grove, IL: Waveland Press.Long Grove, IL: Waveland Press; 2009:.
24. Lawshe C. H.A quantitative approach to content validity.Personnel Psychology. 1975;28:563-575.
25. LimJ. (2008a). Table of specifications evaluation for expert judges: Part 1. Retrieved from http://www.janinelim.com/leadportfolio/pdfs/4b_Ciii_LimVCTableofSpecsPart1.pdf.
26. LimJ. (2008b). Table of specifications evaluation for expert judges: Part 2. Retrieved from http://www.janinelim.com/leadportfolio/pdfs/4b_Ciii_LimVCTableofSpecsPart2.pdf.
27. Lim J.The development of an instrument for K12 coordinators implementing curriculum videoconferencing and a model to predict utilization of videoconferencing. Berrien Springs, MI: Andrews University; 2010:.
28. LimJ.FreedS. (2009). We have the videoconference equipment installed, now what?The Qualitative Report, 14, 433-453. Retrieved from http://www.nova.edu/ssss/QR/QR14-3/lim.pdf.
29. Lundy J. J.Mixed methods approach to assuring content validity. Paper presented at the third annual Patient-Reported Outcome (PRO) Consortium Workshop; 2012Silver Spring, MD; 2012.
30. McNeil K. A.,Newman I.,Steinhauser J.How to be involved in program evaluation: What every administrator needs to know. Lanham, MD: Scarecrow Education; 2005:.
31. Messick S.The interplay of evidence and consequences in the validation of performance assessments.Educational Researcher. 1994;23 (2): 13-23.
32. Messick S.Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning.American Psychologist. 1995;50:741-749.
33. Mosby's medical dictionary. St. Louis, MO: Elsevier; 2008:.
34. Newman I.,Frye B.,Blumenfeld G.,Newman C.An introduction to the basic concepts of measurement and evaluation. Akron, OH: University of Akron; 1973:.
35. Newman I.,McNeil K. A.Conducting survey research in the social sciences. Lanham, MD: University Press of America; 1998:.
36. Newman I.,Newman C.,Brown R.,McNeely S.Conceptual statistics for beginners. 2006). Conceptual statistics for beginners (3rd ed.). Lanham, MD: University Press of America.Lanham, MD: University Press of America; 2006:.
37. Newman I.,Newman D.,Newman C.The handbook of scholarly writing and publishing. Rocco T. S.Hatcher T., ed. San Francisco, CA: Jossey-Bass; 2011:191-208.
38. Nunnally J.Psychometric theory. 1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.New York, NY: McGraw-Hill; 1978:.
39. Nunnally J.,Bernstein I.Psychometric theory. 1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.New York, NY: McGraw-Hill; 1994:.
40. PinedaM. F. (2011). The development and validation of an instrument to measure the attainment of competencies at an intercultural university in Mexico (Unpublished doctoral dissertation proposal), Florida International University, Miami.
41. Polit D. F.,Beck C. T.The content validity index: Are you sure you know what's being reported? critique and recommendations.Research in Nursing & Health. 2006;29:489-497.
42. Polit D. F.,Beck C. T.,Owen S. V.Is the CVI an acceptable indicator of content validity? Appraisal and recommendations.Research in Nursing & Health. 2007;30:459-467.
43. Ridenour C.,Newman I.Mixed methods research: Exploring the interactive continuum. Carbondale, IL: Southern Illinois University Press; 2008:.
44. Rubio D. M.,Berg-Weger M.,Tebb S. S.,Lee E. S.,Rauch S.Objectifying content validity: Conducting a content validity study in social work research.Social Work Research. 2003;27:94-104.
45. Sondergeld T. A.An illustrative example of why mixed-methods research is important in understanding the impact of comprehensive school reform on student outcomes. Paper presented at the annual meeting of the American Educational Research Association; 2011New Orleans, LA; 2011.
46. Strauss A.,Corbin J.Basics of qualitative research: Grounded theory procedures and techniques. Newbury Park, CA: Sage; 1990:.
47. Strauss A.,Corbin J.The handbook of qualitative research. Denzin N. K.Lincoln Y. S., ed. Thousand Oaks, CA: Sage; 1994:273-285.
48. Tashakkori A.,Newman I.International encyclopedia of education. 2010). Mixed methods: Integrating quantitative and qualitative approaches to research. In McGawB.BakerE.PetersonP. P. (Eds.), International encyclopedia of education (3rd ed., pp. 514-520). Oxford, England: Elsevier.McGaw B.Baker E.Peterson P. P., ed. Oxford, England: Elsevier; 2010:514-520.
49. Tashakkori A.,Teddlie C.Handbook of mixed methods in social & behavioral research. Thousand Oaks, CA: Sage; 2003:.
50. Teddlie C.,Tashakkori A.Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences. Los Angeles, CA: Sage; 2009:.
51. Turner B. A.Some practical aspects of qualitative data analysis: One way of organising the cognitive processes associated with the generation of grounded theory.Quality & Quantity. 1981;15:225-247.
52. Wilson F. R.,Pan W.,Schumsky D. A.Recalculation of the critical values for Lawshe's content validity ratio.Measurement and Evaluation in Counseling and Development. 2012;45:197-210.