Development of Items for a Pedagogical Content Knowledge Test Based on Empirical Analysis of Pupils' Errors

International Journal of Science Education

Volumn 34, Issue 7, 2012, Pages 1125-1143

  Jüttner, Melanie ^a   Neuhaus, Birgit J ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

Biology teachers; Pedagogical content knowledge; Professional knowledge; Pupils' errors; Pupils' understanding

Indexed keywords

EID: 84860762052     PISSN: 09500693     EISSN: 14645289     Source Type: Journal    
DOI: 10.1080/09500693.2011.606511     Document Type: Article

References (75)

1. Abell, S. K. 2007. "Research on science teacher knowledge". In Handbook of research on science education, Edited by: Abell, S. K. and Lederman, N. G. 1105-1149. New Jersey: Lawrence Erlbaum Associates.
2. Alexander, P. A., Schallert, D. L. and Hare, V. C. 1991. Coming to terms: How researchers in learning and literacy talk about knowledge. Review of Educational Research, 61(3): 315-343.
3. Allen, M. 2005. Encouraging pupil error may promote better understanding of a scientific concept. School Science Review, 86: 79-85.
4. Allen, M. 2010. Learner error, affectual stimulation, and conceptual change. Journal of Research in Science Teaching, 47(2): 151-173.
5. Ashlock, R. B. 2005. Error patterns in computation: Using error patterns to improve instruction, 9, New York: Macmillan.
6. Bainbridge, R. 1981. To err is human: Towards a more positive approach to young children's mistakes in arithmetic. Mathematics in School, 10(5): 10-13.
7. Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A. and Tsai, Y.-M. 2010. Teachers' mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47: 133-180.
8. Baxter, J. A. and Lederman, N. G. 1999. "Assessment and measurement of pedagogical content knowledge". In Examining pedagogical content knowledge, Edited by: Gess-Newsome, J. and Lederman, N. G. 147-161. Dordrecht: Kluwer.
9. Blömeke, S., Felbrich, A. and Müller, C. 2008. "Messung des erziehungswissenschaftlichenWissens angehender Lehrkräfte [Assessment of student teachers' pedagogical knowledge]". In Professionelle Kompetenz angehender Lehrerinnen und Lehrer-Wissen, Überzeugungen und Lerngelegenheiten deutscher Mathematikstudierender und -referendare: Erste Ergebnisse zur Wirksamkeit der Lehrerausbildung [Professional competence of future teachers---knowledge, beliefs and opportunities for learning of math students and pre-service teachers: Initial results on the effectiveness for teacher education], Edited by: Blömeke, S., Kaiser, G. and Lehmann, R. 171-194. Münster, Germany: Waxmann.
10. Bouvier, A. 1987. The right to make mistakes. For the Learning of Mathematics, 7(3): 17-25.
11. Caleon, I. S. and Subramaniam, R. 2010. Do students know what they know and what they don't know? Using a Four-tier diagnostic test to assess the nature of students' alternative conceptions. Research in Science Education, 40: 313-337.
12. Chi, M. T.H., Slotta, J. D. and DeLeeuw, N. 1994. From things to processes: A theory of conceptual change for learning science concepts. Learning and Instruction, 4: 27-43.
13. Cohen, R. and Yarden, A. 2009. Experienced junior-high-school teachers' PCK in light of a curriculum change: 'The cell is to be studied longitudinal'. Research in Science Education, 39: 131-155.
14. Cokelez, A., Dumon, A. and Taber, K. S. 2008. Upper secondary French pupils, chemical transformations and the 'Register of models'. International Journal of Science Education, 30(6): 807-836.
15. de Jong, T. and Ferguson-Hessler, M. G.M. 1996. Types and qualities of knowledge. Educational Psychologist, 31(2): 105-113.
16. de Laughter, J. E. and Stein, S. 1998. Preconceptions about earth science among pupils in an introductory course. Eos, 79: 429-434.
17. Driver, R. P. 1981. Pupils' alternative frameworks in science. European Journal of Science Education, 3(1): 93-101.
18. Duit, R., Treagust, D. and Widodo, A. 2008. "Teaching science for conceptual change: Theory and practice". In International handbook of research on conceptual change, Edited by: Vosniadou, S. 629-646. New York, London: Routledge.
19. Ericsson, K. A. and Simon, H. A. 1993. Protocol analysis, Cambridge, MA: The MIT Press.
20. Field, A. 2009. Discovering statistics using SPSS, London: Sage.
21. Fischer, H. E., Borowski, A. and Tepner, O. in press. "Professional knowledge of science teachers". In Second international handbook of science education, Edited by: Fraser, B., Tobin, K. and McRobbie, C. New York: Springer.
22. Friedrichsen, P., Abell, S., Pareja, E., Brown, P., Lankford, D. and Volkmann, M. 2009. Does teaching experience matter? Examining biology teachers' prior knowledge for teaching in an alternative certification program. Journal of Research in Science Teaching, 46: 357-383.
23. Gilbert, J., Osborne, R. and Fensham, P. 1982. Children's science and its consequences for teaching. Science Education, 66: 623-633.
24. Gwet, K. L. 2002. Kappa statistic is not satisfactory for assessing the extent of agreement between raters. Statistical Methods For Inter-Rater Reliability Assessment, 1: 1-5. Retrieved fromhttp://agreestat.com/research_papers/kappa_statistic_is_not_satisfactory.pdf
25. Gwet, K. L. 2008. "Interrater reliability". In Wiley encyclopedia of clinical trials Edited by: D'Agostino, R. B., Sullivan, L. and Massaro, J. 473-485. Wiley-Interscience. Retrieved fromhttp://advancedanalyticsllc.com/irrhbk/research_papers/wiley_encyclopedia2008_eoct631.pdf
26. Hammann, M. 2003. Aus Fehlern lernen [Learning by errors]. Unterricht Biologie, 287: 31-35.
27. Hashweh, M. 2005. Teacher pedagogical constructions: A reconfi{ligature}guration of PCK. Teachers and Teaching: Theory and Practice, 11: 273-292.
28. Helm, H. 1980. Misconceptions in physics amongst South African pupils. Physics Education, 15: 92-97.
29. Helmke, A. and Schrader, F.-W. 1987. Interactional effects of instructional quality and teacher judgment accuracy on achievement. Teaching and Teacher Education, 3: 91-98.
30. Henze, I., van Driel, J. H. and Verloop, N. 2008. Development of experienced science teachers' pedagogical content knowledge of models of the solar system and the universe. International Journal of Science Education, 30(10): 1321-1342.
31. Hill, H. C. and Ball, D. L. 2004. Learning mathematics for teaching: Results from California's mathematics professional development institutes. Journal for Research in Mathematics Education, 35(5): 330-351.
32. Hill, H. C., Ball, D. L. and Schilling, S. G. 2008. Unpacking pedagogical content knowledge: Conceptualizing and measuring teachers' topic-specific knowledge of pupils. Journal for Research in Mathematics Education, 39: 372-400.
33. Hill, H. C., Rowan, B. and Loewenberg Ball, D. 2005. Effects of teachers' mathematical knowledge for teaching on student achievement. American Educational Research Journal, 42: 371-406.
34. Hosenfeld, I., Helmke, A. and Schrader, F.-W. 2002. "Diagnostische Kompetenz: Unterrichts- und lernrelevante Schülermerkmale und deren Einschätzung durch Lehrkräfte in der Lehr-Lern-Studie SALVE [Diagnotic competency: teaching and learning relevant to student characteristics and the teachers' prediction in the teaching-learning study SALVE]". In Bildungsqualität von Schule: Schulische und außerschulische Bedingungen mathematischer, naturwissenschaftlicher und überfachlicher Kompetenzen. Zeitschrift für Pädagogik, 45. Beiheft [Quality of education: educational and extracurricular conditions of mathematical, scientific and interdisciplinary competencies. Journal for Pedagogy, 45. supplement], Edited by: Prenzel, M. and Doll, J. 65-82. Weinheim: Beltz.
35. Houssart, J. and Weller, B. 1999. Identifying and dealing with misconceptions and errors in primary mathematics: Student teachers record their experiences. Mathematics Education Review, 11: 46-58.
36. Hsieh, H.-F. and Shannon, S. E. 2005. Three approaches to qualitative content analysis. Qualitative Health Research, 15(9): 1277-1288.
37. Jüttner, M. and Neuhaus, B. 2010. "Using empirically analyzed pupils' errors to develop a PCK-test". In Contemporary science education research: Preservice and inservice teacher education, Edited by: Taşar, M. F. and Çakmakci{dotless}, G. 331-340. Ankara, Turkey: Pegem Akademi.
38. Jüttner, M. and Neuhaus, B. 2011. "Vom Schülerfehler zum PCK-Test. Ansätze zur Entwicklung von PCK-Items [A PCK-test based on students' errors. Rudiments for developing PCK items]". In Lehr- und Lernforschung in der Biologiedidaktik. Band 4 [Research on learning and instruction in biology education], Edited by: Harms, U. and Mackensen-Friedrichs, I. 27-39. Innsbruck: Studien Verlag.
39. Kind, V. 2009. Pedagogical content knowledge in science education: Perspectives and potential for progress. Studies in Science Education, 45(29): 169-204.
40. Krüger, D. 2007. "Die Conceptuale Change-Theorie [The conceptual change theory]". In Handbuch der Theorien in der biologiedidaktischen Forschung [Handbook of research on theories in biology education], Edited by: Krüger, D. and Vogt, H. 81-92. Berlin: Springer Verlag.
41. Landis, J. R. and Koch, G. G. 1977. The measurement of observer agreement for categorical data. Biometrics, 33(1): 159-174.
42. Lee, E. and Luft, J. A. 2008. Experienced secondary science teachers' representation of pedagogical content knowledge. International Journal of Science Education, 30: 1343-1363.
43. Leighton, J. P. Paper presented at the National Council on Measurement in Education (NCME). CA. Two types of think aloud interviews for educational measurement: Protocol and verbal analysis,
44. Lipowsky, F. 2006. Auf den Lehrer kommt es an. Empirische Evidenzen für Zusammenhänge zwischen Lehrerkompetenzen, Lehrerhandeln und dem Lernen der Schüler [It depends on the teacher. Empirical evidences of the connection between teachers' competence, teachers' acting and the learning of the pupils]. Zeitschrift für Pädagogik, 52(51): 47-70.
45. Loughran, J., Mulhall, P. and Berry, A. 2008. Exploring pedagogical content knowledge in science teacher education. International Journal of Science Education, 30(10): 1301-1320.
46. Magnusson, S., Krajcik, J. and Borko, H. 1999. "Nature, sources and development of pedagogical content knowledge for science teaching". In Examining pedagogical content knowledge: The construct and its implications for science education, Edited by: Gess-Newsome, J. and Lederman, N. G. 95-131. Dordrecht: Kluwer Academic Publishers.
47. Mayring, P. (2000). Qualitative Content Analysis [28 paragraphs]. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 1(2), Art. 20. Retrieved fromhttp://nbn-resolving.de/urn:nbn:de:0114-fqs0002204
48. Nebah, S.J. (2002). Do people learn from mistakes? A pedagogical study and analysis of autobiographies and interviews. Dissertation Departement Erziehungswissenschaften, Universität Fribourg.
49. Novak, G. S. 1977. "Representations of knowledge in a program for solving physics problems". In Proceedings of the Fifth International Joint Conference on Artificial Intelligence, 286-291. Cambridge, MA: MIT Press.
50. Oser, F., Hascher, T. and Spychiger, M. 1999. "Lernen aus Fehlern. Zur Psychologie der 'negativen' Wissens [Learning out of errors. About the psychology of the 'negative' knowledge]". In Fehlerwelten: vom Fehlermachen und Lernen aus Fehlern [World of errors: about making errors and learning by errors], Edited by: Althof, W. 11-43. Opladen: Leske + Budrich.
51. Oser, F. and Spychiger, M. 2005. Lernen ist schmerzhaft. Zur Theorie des negativen Wissens und zur Praxis der Fehlerkultur [Learning is painful. About the theory of the negative knowledge and about the practice of the culture of errors], Weinheim: Beltz.
52. Paris, S., Lipson, M. and Wixson, K. 1983. Becoming a strategic reader. Contemporary Educational Psychology, 8: 293-316.
53. Park, S., Jang, J.-Y. and Chen, Y.-C. 2010. Is Pedagogical Content Knowledge (PCK) necessary for reformed science teaching? Evidence from an empirical study. Research in Science Education, 41: 245-260. doi:10.1007/s11165-009-9163-8
54. Park, S. and Oliver, J. S. 2008. Revisiting the conceptualisation of pedagogical content knowledge (PCK): PCK as a conceptual tool to understand teachers as professionals. Research in Science Education, 38: 261-284.
55. Schmelzing, S., Wüsten, S., Sandmann, A. and Neuhaus, B. 2010. "Measuring declarative and reflective components of biology teachers' pedagogical content knowledge". In Contemporary science education research: Teaching, Edited by: Tasar, M. F. and Cakmakci, G. 71-77. Ankara, Turkey: Pegem Akademi.
56. Schmidt, W. H., Tatto, M. T., Bankov, K., Blömeke, S., Cedillo, T., Cogan, L.and Schwille, J. 2007. The preparation gap: Teacher education for middle school mathematics in six countries. Mathematics teaching in the 21st century (MT21) (pp. 1-47), MSU Center for Research in Mathematics and Science Education, Retrieved August 2, 2011, from http://usteds.msu.edu/MT21Report.pdf
57. Schori, E., Kersten, B. and Abderhalden, C. 2006. Wie reliabel ist der Fragebogen zur Analyse der Pflegedokumentation IzEP-Dok© im Instrument zur Erfassung von Pflegesystemen IzEP©? [How reliable is the questionnaire for the analysis of nursing documentation IzEP-Dok© as part of the measurement instrument for collecting data of the care systems IzEP©?]. Printernet Angewandte Pflegeforschung, 8: 1-9.
58. Schumacher, R. 2008. "Der produktive Umgang mit Fehlern. Fehler als Lerngelegenheit und Orientierungshilfe [The productive handling with errors. Errors as learning opportunity and for orientation]". In Nur wer Fehler macht, kommt weiter. Wege zu einer neuen Lernkultur [Only the one who is making errors is going one step further. Ways to a new learning culture], Edited by: Caspary, R. 7-11. Freiburg: Herder.
59. Schwarz, B., Wissmach, B. and Kaiser, G. 2008. 'Last curves not quite correct': diagnostic competences of future teachers with regard to modelling and graphical representations. ZDM-The International Journal on Mathematics Education, 40(5): 777-790.
60. Seidel, T. and Shavelson, R. J. 2007. Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Education Research, 77: 454-499.
61. Seifried, J. and Wuttke, E. 2010. Student errors: how teachers diagnose them and how they respond to them. Empirical Research in Vocational Education and Training (ERVET), 2(2): 147-162.
62. Shoukri, M. M. 2004. Measures of interobserver agreement, Boca Raton, FL: CRC PR Inc.
63. Shrout, P. E. and Fleiss, J. L. 1979. Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2): 420-428.
64. Shulman, L. 1986. Those who understand. Knowledge growth in teaching. Educational Researcher, 15: 4-14.
65. Shulman, L. 1987. Knowledge and teaching: Foundations of the new reform. Havard Educational Review, 57: 1-22.
66. Spychiger, M. 2008. "Ein offenes Spiel. Lernen aus Fehlern und Entwicklung von Fehlerkutur [An open play. Learning by errors and the development of the culture of errors]". In Nur wer Fehler macht, kommt weiter. Wege zu einer neuen Lernkultur [Only the one who is making errors is going one step further. Ways to a new learning culture], Edited by: Caspary, R. 25-48. Freiburg: Herder.
67. Taber, K. S. 2009. Progressing science education: Constructing the scientific research programme into the contingent nature of learning science, Dordrecht: Springer.
68. Tanner, K. and Allen, D. 2005. Approaches to biology teaching and learning: From a scholarly approach to teaching to the scholarship of teaching. Cell Biology Education, 4: 1-6.
69. Tatto, M. T., Schwille, J., Senk, S., Ingvarson, L., Peck, R., Rowley, G.,Cogan, L. (2007). Teacher Education and Development Study in Mathematics (TEDS-M 2008). Conceptual Framework. Field Trial. Teacher Education and Development International Study Center, East Lansing, MI: College of Education, Michigan State University.
70. Tepner, O., Borowski, A., Fischer, H. E., Jüttner, M., Kirschner, S., Leutner, D.,and Witner, S. submitted. Modell zur Entwicklung von Testitems zur Erfassung des Professionswissens von Lehrkräften in den Naturwissenschaften [Theoretical model for the development of test-items to collect data about professional knowledge of science teachers]. Zeitschrift der Naturwissenschaften,
71. Treagust, D. F. 1988. Development and use of diagnostic tests to evaluate students' misconceptions in science. International Journal of Science Education, 10(2): 159-169.
72. Tsai, C.-C. and Chou, C. 2002. Diagnosing pupils' alternative conceptions in science. Journal of Computer Assisted Learning, 18: 157-165.
73. Tsamir, P., Rasslan, S. and Dreyfus, T. 2006. Prospective teachers' reactions to right-or-wrong tasks: The case of derivatives of absolute value functions. Journal of Mathematical Behavior, 25: 240-251.
74. Van Driel, J. H., Beijaard, D. and Verloop, N. 2001. Professional development and reform in science education: The role of teachers' practical knowledge. Journal of Research in Science Teaching, 38: 137-158.
75. Van Driel, J. H., Verloop, N. and de Vos, W. 1998. Developing science teachers' pedagogical content knowledge. Journal of Research in Science Teaching, 35: 673-695.