Designing a mixed-methods research instrument and scoring rubric to investigate individuals' conceptions of plate tectonics

Special Paper of the Geological Society of America

Volumn 474, Issue , 2011, Pages 81-96

  Clark, Scott K ^a   Libarkin, Julie C ^a  

^a MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

TECTONICS;

CONCEPTUAL UNDERSTANDING; DEVELOPMENT PROCESS; EDUCATION RESEARCH; MIXED-METHODS RESEARCH; QUALITATIVE APPROACH; SURVEY INSTRUMENTS; THEMATIC ANALYSIS; U.S. GEOLOGICAL SURVEYS;

ITERATIVE METHODS;

DESIGN; GEOGRAPHY EDUCATION; GEOLOGICAL SURVEY; INSTRUMENTATION; PLATE TECTONICS; RESEARCH;

EID: 79960190788     PISSN: 00721077     EISSN: None     Source Type: Book Series    
DOI: 10.1130/2011.2474(07)     Document Type: Article

References (54)

1. Adams, W.K., Perkins, K.K., Podelefsky, N.S., Dubson, M., Finkelstein, N.D., and Wieman, C.E., 2006, New instrument for measuring student beliefs about physics and learning physics: The Colorado Learning Attitudes about Science Survey: Physical Review Special Topics-Physics Education Research, v. 2, p. 010101:1-14.
2. Ambrose, R., Clement, L., Philipp, R., and Chauvot, J., 2004, Assessing prospective elementary school teachers' beliefs about mathematics and mathematics learning: Rationale and development of a constructed-responseformat beliefs survey: School Science and Mathematics, v. 104, no. 2, p. 56-69, doi:10.1111/j.1949-8594.2004.tb17983.x.
3. Bandura, A., 1984, Recycling misconceptions of perceived self-effi cacy: Cognitive Therapy and Research, v. 8, no. 3, p. 231-255, doi:10.1007/ BF01172995.
4. Beatty, P.C., and Willis, G.B., 2007, Research synthesis: The practice of cognitive interviewing: Public Opinion Quarterly, v. 71, no. 2, p. 287-311, doi:10.1093/poq/nfm006.
5. Bresciani, M.J., Oakleaf, M., Kolkhorst, F., Nebeker, C., Barlow, J., Duncan, K., and Hickmott, J., 2009, Examining design and inter-rater reliability of a rubric measuring research quality across multiple disciplines: Practical Assessment, Research, & Evaluation, v. 14, no. 12, p. 1-7. (Available online at: http://pareonline.net/getvn.asp?v=14&n=12.)
6. Britton, E.D., and Schneider, S.A., 2007, Large-scale assessments in science education, in Abell, S.K., and Lederman, N.G., eds., Handbook of Research on Science Education: Mahwah, New Jersey, Lawrence Erlbaum Associates, p. 1007-1040.
7. Clark, S.K., 2009, Plate tectonics as viewed by novices and experts: Geological Society of America Abstracts with Programs, v. 41, no. 7, p. 251.
8. Clark, S.K., and Libarkin, J.C., 2008, Postinstruction alternative conceptions about plate tectonics held by nonscience majors: Geological Society of America Abstracts with Programs, v. 40, no. 6, p. 364.
9. Collins, D., 2003, Pretesting survey instruments: An overview of cognitive methods: Quality of Life Research, v. 12, p. 229-238, doi:10.1023/A:1023254226592. (Pubitemid 36549531)
10. Creswell, J.W., 2003, Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (2nd ed.): Thousand Oaks, California, Sage Publications, 246 p.
11. Creswell, J.W., and Miller, D.L., 2000, Determining validity in qualitative inquiry: Theory into Practice, v. 39, no. 3, p. 124-130, doi:10.1207/ s15430421tip3903-2.
12. Crotty, M., 1998, The Foundations of Social Research: Thousand Oaks, California, Sage Publications, 248 p.
13. Denzin, N.K., and Lincoln, Y.S., eds., 1998, Strategies of Qualitative Inquiry: Thousand Oaks, California, Sage Publications, 346 p.
14. Driver, R., 1989, Students' conceptions and the learning of science: International Journal of Science Education, v. 11, p. 481-490, doi:10.1080/ 0950069890110501.
15. Duschl, R.A., Schweingruber, H.A., and Shouse, A.W., eds., 2007, Taking Science to School: Learning and Teaching Science in Grades K-8: Washington, D.C., National Academies Press, 387 p.
16. Feig, A., 2010, this volume, Methodology and location in the context of qualitative data and theoretical frameworks in geoscience education research, in Feig, A.D., and Stokes, A., eds., Qualitative Inquiry in Geoscience Education Research: Geological Society of America Special Paper 474, doi:10.1130/2011. 2474(01).
17. Fink, A.G., 2003, The Survey Handbook (2nd ed.): Thousand Oaks, California, Sage Publications, 184 p.
18. Golafshani, N., 2003, Understanding reliability and validity in qualitative research: Qualitative Report, v. 8, no. 4, p. 597-607.
19. Greene, J.C., Caracelli, V.J., and Graham, W.F., 1989, Toward a conceptual framework for mixed-method evaluation designs: Educational Evaluation and Policy Analysis, v. 11, no. 3, p. 255-274.
20. Harp, S.F., and Mayer, R.E., 1998, How seductive details do their damage: A theory of cognitive interest in science learning: Journal of Educational Psychology, v. 90, no. 3, p. 414-434, doi:10.1037/0022-0663.90.3.414.
21. Hossler, D., and Vesper, N., 1993, An exploratory study of the factors associated with parental saving for postsecondary education: The Journal of Higher Education, v. 64, no. 2, p. 140-165, doi:10.2307/2960027.
22. Johnson, R.B., and Onwuegbuzie, A.J., 2004, Mixed methods research: A research paradigm whose time has come: Educational Researcher, v. 33, no. 7, p. 14-26, doi:10.3102/0013189X033007014. (Pubitemid 39519587)
23. Kidder, L.H., and Fine, M., 1987, Qualitative and quantitative methods: When stories converge: in Mark, M.M., and Shotland, R.L., eds., Multiple Methods in Program Evaluation: San Francisco, California, Jossey-Bass, p. 57-75.
24. Kortz, K.M., Clark, S.K., Gray, K., Smay, J.J., Viveiros, B., and Steer, D., 2011, this volume, Counting tectonic plates: A mixed-methods study of college students' conceptions of plates and boundaries, in Feig, A.D., and Stokes, A., eds., Qualitative Inquiry in Geoscience Education Research: Geological Society of America Special Paper 474, doi:10.1130/2011.2474(12).
25. Kvale, S., and Brinkmann, S., 2009, Interviews: Learning the Craft of Qualitative Research Interviewing: Thousand Oaks, California, Sage Publications, 354 p.
26. Lederman, N.G., Abd-El-Khalick, F., Bell, R.L., and Schwartz, R., 2002, Views of nature of science questionnaire: Toward valid and meaningful assessment of learner's conceptions of nature of science: Journal of Research in Science Teaching, v. 39, p. 497-521, doi:10.1002/tea.10034. (Pubitemid 34858154)
27. Lewis, J., 2009, Redefi ning qualitative methods: Believability in the fi fth moment: International Journal of Qualitative Methods, v. 8, no. 2, p. 1-14.
28. Libarkin, J.C., 2008, Concept inventories in higher education science, in National Research Council, Promising Practices in Undergraduate STEM Education Workshop 2 (Washington, D.C., 13-14 October 2008): http://www7. nationalacademies.org/bose/PP-Commissioned-Papers.html (accessed 30 October 2009).
29. Libarkin, J.C., and Kurdziel, J.P., 2002, Research methodologies in science education: Qualitative data: Journal of Geoscience Education, v. 50, no. 2, p. 195-200.
30. Lincoln, Y.S., and Guba, E.G., 1985, Naturalistic Inquiry: Beverly Hills, California, Sage Publishing, 416 p.
31. Litwin, M.S., 1995, How to Measure Survey Reliability and Validity: Thousand Oaks, California, Sage Publications, 87 p.
32. Lopez, W., 1996, Communication validity and rating scales: Rasch Measurement Transactions, v. 10, no. 1, p. 482-483.
33. Marshall, C., and Rossman, G.B., 2006, Designing Qualitative Research: Thousand Oaks, California, Sage Publications, 262 p.
34. Maxwell, J.A., 2005, Qualitative Research Design: An Interactive Approach (2nd ed.): Thousand Oaks, California, Sage Publications, 192 p.
35. Merriam, S.B., 2002, Introduction to qualitative research, in Merriam, S.B., ed., Qualitative Research in Practice: San Francisco, California, Jossey-Bass, p. 3-17.
36. Morse, J.M., Barrett, M., Mayan, M., Olson, K., and Spiers, J., 2002, Verifi cation strategies for establishing reliability and validity in qualitative research: International Journal of Qualitative Methods, v. 1, no. 2, p. 13-22.
37. Onwuegbuzie, A.J., and Johnson, R.B., 2006, The validity issue in mixed research: Research in the Schools, v. 13, no. 1, p. 48-63.
38. Patton, M.Q., 2002, Qualitative Evaluation and Research Methods (3rd ed.): Thousand Oaks, California, Sage Publications, 598 p.
39. Phillips, D.C., and Burbules, N.C., 2000, Postpositivism and Educational Research: Lanham, Maryland, Rowman & Littlefi eld Publishers, 101 p.
40. Posner, G.J., Strike, K.A., Hweson, P.W., and Gertzog, W.A., 1982, Accommodation of a Scientific conception: Toward a theory of conceptual change: Science Education, v. 66, no. 2, p. 211-227, doi:10.1002/sce.3730660207.
41. Presser, S., Couper, M.P., Lessler, J.T., Martin, E., Martin, J., Rothgeb, J.M., and Singer, E., 2004, Methods for testing and evaluating survey questions:Public Opinion Quarterly, v. 68, no. 1, p. 109-130, doi:10.1093/poq/ nfh008. (Pubitemid 38750631)
42. Rossman, G.B., and Wilson, B.L., 1985, Numbers and words: Combining quantitative and qualitative methods in a single large-scale evaluation study: Evaluation Review, v. 9, no. 5, p. 627-643, doi:10.1177/ 0193841X8500900505.
43. Sanchez, M.E., 1992, Effects of questionnaire design on the quality of survey data: Public Opinion Quarterly, v. 56, no. 2, p. 206-217, doi:10.1086/269311.
44. Simkin, T., Tilling, R.I., Taggart, J.N., Jones, W.J., and Spall, H., 1989, This Dynamic Planet: World Map of Volcanoes, Earthquakes, and Tectonic Plates: U.S. Geological Survey (in collaboration with the Smithsonian Institution) Map I-2800, scale 1:30,000,000.
45. Simkin, T., Ungar, J.D., Tilling, R.I., Vogt, P.R., and Spall, H., 1994, This Dynamic Planet: World Map of Volcanoes, Earthquakes, and Tectonic Plates (2nd ed.): U.S. Geological Survey (in collaboration with the Smithsonian Institution and U.S. Naval Research Laboratory) Map I-2800, scale 1:30,000,000.
46. Simkin, T., Tilling, R.I., Vogt, P.R., Kirby, S.H., Kimberly, P., and Stewart, D.B., 2006, This Dynamic Planet: World Map of Volcanoes, Earthquakes, Impact Craters, and Plate Tectonics: U.S. Geological Survey (in collaboration with the Smithsonian Institution and U.S. Naval Research Laboratory) Geologic Investigations Series Map I-2800, scale 1:30,000,000 (and companion website: http://www.minerals.si.edu/tdpmap).
47. Siragusa, L., and Dixon, K.C., 2006, A research methodology: The development of survey instruments for research into online learning in higher education: Issues in Educational Research, v. 16, p. 206-225.
48. Solano-Flores, G., and Nelson-Barber, S., 2001, On the cultural validity of science assessments: Journal of Research in Science Teaching, v. 38, no. 5, p. 553-573, doi:10.1002/tea.1018. (Pubitemid 33655580)
49. Strahler, A.N., 1998, Plate Tectonics: Cambridge, Massachusetts, GeoBooks Publishing, 554 p.
50. Tashakkori, A., and Teddlie, C., 1998, Mixed Methodology: Combining Qualitative and Quantitative Approaches: Thousand Oaks, California, Sage Publications, 185 p.
51. Tashakkori, A., and Teddlie, C., 2003, Handbook of Mixed Methods in Social & Behavioral Research: Thousand Oaks, California, Sage Publications, 768 p.
52. Thomas, S.J., 2004, Using Web and Paper Questionnaires for Data-Based Decision Making: From Design to Interpretation of the Results: Thousand Oaks, California, Corwin Press, 194 p.
53. Trochim, W.M.K., and Donnelly, J.P., 2007, The Research Methods Knowledge Base (3rd ed.): Cincinnati, Ohio, Atomic Dog Publishing, 361 p. (companion website: http://www.socialresearchmethods.net/kb/).
54. U.S. Geological Survey Education webpage, 2010, USGS Map Databases: http://education.usgs.gov/common/map-databases.htm (accessed 12 March 2010).