Measuring knowledge of natural selection: A comparison of the CINS, an open-response instrument, and an oral interview

Journal of Research in Science Teaching

Volumn 45, Issue 10, 2008, Pages 1131-1160

  Nehm, Ross H ^a   Schonfeld, Irvin Sam ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b CITY COLLEGE OF NEW YORK   (United States)

Author keywords

Alternative conceptions; Assessment; Evolution; Natural selection

Indexed keywords

ALTERNATIVE CONCEPTIONS; ANDERSON; ASSESSMENT; DISCRIMINABILITY; EVOLUTION; LESSER EXTENTS; METHODOLOGICAL TOOLS; NATURAL SELECTION; NATURAL SELECTIONS; RIGOROUS EVALUATIONS; SCIENCE TEACHINGS;

SEMICONDUCTOR QUANTUM DOTS;

INSTRUMENTS;

EID: 57249116250     PISSN: 00224308     EISSN: 10982736     Source Type: Journal    
DOI: 10.1002/tea.20251     Document Type: Article

References (58)

1. Anastasi, A. (1976). Psychological testing. NewYork: Macmillan.
2. Anderson, D.L., Fisher, K.M., & Norman, G.J. (2002). Development and evaluation of the conceptual inventory of natural science. Journal of Research in Science Teaching, 39, 952-978
3. Ary, D., Jacobs, L.C., & Razavieh, A. (2002). Introduction to research in education (6th ed.). Belmont, CA: Wadsworth/Thomson Learning.
4. Atran, S. (1990). Cognitive foundations of natural history. Cambridge: Cambridge University Press.
5. Azizoglu, N., Alkan, M., & Geban, Ö. (2006). Undergraduate pre-service teachers' understandings and misconceptions of phase equilibrium. Journal of Chemical Education, 83, 947-953.
6. Bennett, R.E. (1993). On the meaning of constructed response. In R.N. Bennett & W.C. Ward (Eds.), Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessment (pp. 1 -28). Hillsdale, NJ: Erlbaum.
7. Bishop, B., & Anderson, C. (1990). Student conceptions of natural selection and its role in evolution. Journal of Research in Science Teaching, 27, 415-427.
8. Bloom, B. (1956). Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay.
9. Bode, R.K., & Wright, B.D. (1999). Rasch measurement in higher education. In J.C. Smart & W.G. Tierney (Eds.), Handbook of Theory and Research, Volume XIV. New York: Agathon Press.
10. Boone, W.J., & Scantlebury, K. (2006). The role of Rasch analysis when conducting science education research utilizing multiple-choice tests. Science Education, 90, 253-269
11. Bond, T.G., & Fox, CM. (2001). Applying the Rasch Model: Fundamental measurement in the human sciences. Mahwah NJ: Lawrence Erlbaum Associates.
12. Bridgeman, B. (1992). A comparison of quantitative questions in open-ended and multiple choice formats. Journal of Educational Measurement, 29, 253-271.
13. Brooks, D.J. (2001). Substantial numbers of Americans continue to doubt evolution as explanation for origin of humans. (March 5,2001) Available online at: 〈http://www.gallup.com/poll/releases/pr010305.asp〉.
14. Brumby, M. (1984). Alternative conceptions about the concept of natural selection by medical biology students. Science Education, 68, 493-503.
15. Carver, R.P. (1974). Two dimensions of tests: Psychometric and edumetric. American Psychologist, 29, 512-518.
16. Chiu, M. (2005). A national survey of students' conceptions in chemistry in Taiwan. Chemical Education International, 6, 1 -8.
17. Clough, E.E., & Wood-Robinson, C. (1985). How secondary students interpret instances of biological adaptation. Journal of Biological Education, 19, 125-130.
18. Colburn, A., & Henriques, L. (2006). Clergy views on evolution, creationism, science, and religion. Journal of Research in Science Teaching, 43, 419-442.
19. Crawford, B.A., Zembal-Saul, C., Munford, D., & Friedrichsen, P. (2005). Confronting prospective teachers' ideas of evolution and scientific inquiry using technology and inquiry-based tasks. Journal of Research in Science Teaching, 42, 613-637.
20. Cronbach, L.J. (1975). Dissent from Carver. American Psychologist, 30, 602.
21. Dagher, Z.R., & BouJaoude, S. (1997). Scientific views and religious beliefs of college students: The case of biological evolution. Journal of Research in Science Teaching, 34, 429-445.
22. Demastes, S.S., Settlage, J., & Good, R.G. (1995). Students' conceptions of natural selection and its role in evolution: Cases of replication and comparison. Journal of Research in Science Teaching, 32, 535-550.
23. Donnelly, L.A., & Boone, W.J. (2007). Biology teachers' attitudes toward and use of Indiana's evolution standards. Journal of Research in Science Teaching, 44, 236-257.
24. Gould, S.J. (2002). The Structure of Evolutionary Theory. Cambridge: Belknap of Harvard University Press.
25. Grose, E.C., & Simpson, R.D. (1982). Attitude of introductory college biology students toward evolution. Journal of Research in Science Teaching, 19, 15-24.
26. Haladyna, T.M. (1975). On the psychometric-edumetric dimensions of tests. American Psychologist, 30, 603-604.
27. Ingram, E., & Nelson, C. (2006). Relationship between achievement and students' acceptance of evolution or creation in an upper-level evolution course. Journal of Research in Science Teaching, 43, 7-24.
28. Jackson, D.F., Doster, E.C., Meadows, L., & Wood, T. (1995). Hearts and minds in the science classroom: The education of a confirmed evolutionist. Journal of Research in Science Teaching, 32,585-611.
29. King, D.J. (1975). Control groups. American Psychologist, 30, 602.
30. Kitcher, P. (2007). Living with Darwin. Oxford: Oxford University Press.
31. Kuechler, W.L., & Simkin, M.G. (2003). How Well Do Multiple Choice Tests Evaluate Student Understanding in Computer Programming Classes? Journal of Information Systems Education, 14, 389-399.
32. Lerner, L.S. (2000). Good science, bad science: Teaching of evolution in the states. Washington, DC: Thomas B. Fordham Foundation.
33. Linacre, J.M. (2006). WINSTEPS: Rasch measurement computer program. Chicago: Winsteps.com .
34. Libarkin, J.C., & Anderson, S.W. (2006). The Geoscience Concept Inventory: Application of Rasch analysis to concept inventory in higher education. In X. Liu & W.J. Boone (Eds.), Applications of Rasch measurement in science education (pp. 45-73). Minnesota: JAM Press.
35. Liu, X., & Boone, W.J. (2006). Applications of Rasch measurement in science education. Minnesota: JAM Press.
36. Liu, X., & Lesniak, K. (2005). Students' progression of understanding the matter concept from elementary to high school. Journal of Research in Science Teaching, 89, 433-450.
37. Lukhele, R., Thissen, D., & Wainer, H. (1994). On the relative value of multiple-choice, constructed-response, and examinee-selected items on two achievement tests. Journal of Educational Measurement, 30, 234-250.
38. Mayr, E. (1982). The growth of biological thought. Cambridge, MA: Harvard University Press.
39. Millman, J., & Popham, WJ. (1974). The issue of item and test variance for criterion-referenced tests: A clarification. Journal of Educational Measurement, 11, 137-138.
40. Moore, R. (2001). Teaching evolution: Do state standards matter? Reports of the National Center for Science Education, 21, 19-21.
41. National Research Council (NRC). (1996). National science education standards. Washington, DC: National Academy Press.
42. National Research Council (NRC). (2001). Knowing What Students Know. Washington, DC: National Academies Press.
43. Nehm, R.H. (2006). Faith-based evolution education? Bioscience, 56, 638-639.
44. Nehm, R.H., & Reilly, L. (2007). Biology majors knowledge and misconceptions of natural selection. Bioscience, 57, 263-272.
45. Nehm, R.H., & Schonfeld, I.S. (2007). Does increasing biology teacher knowledge about evolution and the nature of science lead to greater advocacy for teaching evolution in schools? Journal of Science Teacher Education, 18,693-794.
46. Newport, F. (2004). Third of Americans Say Evidence Has Supported Darwin's Evolution Theory; Almost half of Americans believe God created humans 10,000 years ago. Gallup Organization, November 19. Popham, W.J. (2006). Assessment for educational leaders. New York: Pearson.
47. Rodriguez, M. (2003). Construct equivalence of multiple-choice and constructed-response items: A random effects synthesis of correlations. Journal of Educational Measurement, 40, 163-184.
48. Scharmann, E.G.. & Harris, W.M. (1992). Teaching evolution: Understanding and applying the nature of science. Journal of Research in Science Teaching, 29, 375-388.
49. Scharmann, L.C. (1993). Teaching evolution: Designing successful instruction. The American Biology Teacher, 55, 481-486.
50. Scheurich, J.J., & Young, M.D. (1998). Coloring epistemologies: Are our research epistemologies racially colored? Educational Researcher, 26, 4-16.
51. Skoog, G., & Bilica, K. (2002). The emphasis given to evolution in state standards: A lever for change in evolution education? Science Education, 86, 445-462.
52. Sinatra, G.M., Southerland, S.A., McConaughy, E, & Demastes, J.W. (2003). Intentions and beliefs in students' understanding and acceptance of biological evolution. Journal of Research in Science Teaching, 40, 510-528.
53. Southerland, S., & Sinatra, G. (2003). Learning about biological evolution: A special case of intentional conceptual change. Chapter 11. In: G. Sinatra & P.R. Pintrich (Eds.), Intentional conceptual change Mahwah, NJ: Lawrence Erlbaum Associates.
54. Traub, R.E., & MacRury, K. (1990). Multiple-choice vs. free-response in the testing of scholastic achievement. Unpublished manuscript, The Ontario Institute for Studies in Education. Published in German. In: K. Ingenkamp & R.S. Jager (Eds.), Tests und trends 8: Jahrbuchder Paaizgogischen Diagnosrik (pp. 128-159). Weinheim & Basel: Beltz Verlag.
55. Vygotsky, L.S. (1978). Mind and society: The development of higher mental processes. Cambridge, MA: Harvard University Press.
56. Wandersee, J.H., Mintzes, J.J., & Novak, J.D. (1994). Research on alternative conceptions in science. In: D. Gabel (Ed.), Handbook of Research on Science Teaching and Learning (pp. 177-210). Simon & Schuster Macmillan: New York.
57. Zeidner, M. (1993). Essay versus multiple choice type classroom exams: The student's perspective. In B. Nevo & R.S. Jager (Eds.), Educational and psychological testing: The test-takers outlook (pp. 67-82). Toronto: Hogrefe & Huber.
58. Zimmerman, M. (1987). The evolution-creation controversy: Opinions of Ohio high school biology teachers. Ohio Journal of Science, 87(4), 115-125.