Students' understandings of acid strength: How meaningful is reliability when measuring alternative conceptions?

Journal of Chemical Education

Volumn 92, Issue 2, 2015, Pages 212-219

  Bretz, Stacey Lowery ^a   McClary, Lakeisha ^a  

^a MIAMI UNIVERSITY   (United States)

Author keywords

Acids Bases; Chemical Education Research; Misconceptions Discrepant Events; Organic Chemistry; Second Year Undergraduate; Testing Assessment

Indexed keywords

EID: 84923651427     PISSN: 00219584     EISSN: 19381328     Source Type: Journal    
DOI: 10.1021/ed5005195     Document Type: Article

References (75)

1. Bhattacharyya, G. Practitioner Development in Organic Chemistry: How Graduate Students Conceptualize Organic Acids Chem. Educ. Res. Pract. 2006, 7 (4) 240-247
2. Cartrette, D. P.; Mayo, P. M. Students' Understanding of Acids/Bases in Organic Chemistry Contexts Chem. Educ. Res. Pract. 2011, 12 (1) 29-39
3. Cros, D.; Maurin, M.; Amouroux, R.; Chastrette, M.; Leber, J.; Fayol, M. Conceptions of First-Year University Students of the Constituents of Matter and the Notions of Acids and Bases Int. J. Sci. Educ. 1986, 8 (3) 305-313
4. Demerouti, M.; Kousathana, M.; Tsaparlis, G. Acid-Base Equilibria, Part I. Upper Secondary Students' Misconceptions and Difficulties Chem. Educ. 2004, 9 (2) 122-131
5. Nakhleh, M. B. Students' Models of Matter in the Context of Acid-Base Chemistry J. Chem. Educ. 1994, 71 (6) 495-499
6. Carr, M. Model Confusion in Chemistry Res. Sci. Educ. 1984, 14 (1) 97-103
7. Bradley, J. D.; Mosimege, M. D. Misconceptions in Acids and Bases: A comparative Study of Student Teachers with Different Chemistry Backgrounds S. Afr. J. Chem. 1998, 51, 137-145
8. Kousathana, M.; Demerouti, M.; Tsaparlis, G. Instructional Misconceptions in Acid-Base Equilibria: An Analysis from a History and Philosophy of Science Perspective Sci. Educ. 2005, 14 (2) 173-193
9. Rahayu, S.; Chandrasegaran, A. L.; Treagust, D. F.; Kita, M.; Ibnu, S. Understanding Acid-Base Concepts: Evaluating the Efficacy of a Senior High School Student-Centered Instructional Program in Indonesia Int. J. Sci. Math. Educ. 2011, 9 (6) 1439-1458
10. Ross, B.; Munby, H. Concept Mapping and Misconceptions: A Study of High-School Students' Understandings of Acids and Bases Int. J. Sci. Educ. 1991, 13 (1) 11-23
11. Dreschler, M.; van Driel, J. Teachers' Perceptions of the Teaching of Acids and Bases in Swedish Upper Secondary Schools Chem. Educ. Res. Pract. 2009, 10 (2) 86-96
12. Duis, J. M. Organic Chemistry Educators' Perspectives on Fundamental Concepts and Misconceptions J. Chem. Educ. 2011, 88 (3) 346-350
13. Driver, R.; Erikson, J. Theories-in-Action: Some Theoretical and Empirical Issues in the Study of Students' Conceptual Frameworks in Science Stud. Sci. Educ. 1983, 10 (1) 37-60
14. Gentner, D. Psychology of mental models. In International Encyclopedia of the Social and Behavioral Sciences; Smelser, N.J.; Bates, P.B., Eds.; Elsevier Science: Amsterdam, 2002; pp 9683-9687.
15. Talanquer, V. Commonsense Chemistry: A Model for Understanding Students' Alternative Conceptions J. Chem. Educ. 2006, 83 (5) 811-816
16. van Geenan, E. W.; Witteman, C. L. M. How Experts Reason: The Acquisition of Experts' Knowledge Structures Knowl. Eng. Rev. 2006, 21 (4) 335-344
17. Greca, I. M.; Moreira, M. A. Mental Models, Conceptual Models, and Modelling Int. J. Sci. Educ. 2000, 22 (1) 1-11
18. Talanquer, V. Exploring Dominant Types of Explanations Built by General Chemistry Students Int. J. Sci. Educ. 2010, 32 (18) 2393-2412
19. Johnson-Laird, P. Mental Models: Towards a Cognitive Science of Language, Inference, And Consciousness; Cambridge University Press/Harvard University Press: Cambridge, MA, 1983.
20. Norman, D. A. Some Observations on Mental Models. In Gentner, D.; Stevens, A. L., Eds.; Mental Models; Psychology Press: London, 1983; pp 7-14.
21. Vosniadou, S. Capturing and Modeling the Process of Conceptual Change Learn. Instr. 1994, 4 (1) 45-69
22. Vosniadou, S. Mental Models in Conceptual Development. In Magnani, L.; Nersessian, N., Eds.; Model-Based Reasoning: Science, Technology, Values; Kluwer Academic Press: New York, 2002; pp 353-368.
23. Coll, R. K.; Treagust, D. F. Learners' Mental Models of Chemical Bonding Res. Sci. Educ. 2001, 31 (3) 357-382
24. Coll, R. K.; Treagust, D. F. Investigation of Secondary School, Undergraduate, and Graduate Learners' Mental Models of Ionic Bonding J. Res. Sci. Teach. 2003, 40 (5) 464-486
25. Taber, K. S. Mediating Mental Models of Metals: Acknowledging the Priority of the Learner's Prior Learning Sci. Educ. 2003, 87 (5) 732-758
26. Luxford, C. J.; Bretz, S. L. Moving Beyond Definitions: What Student Generated Models Reveal about Their Understanding of Covalent Bonding and Ionic Bonding Chem. Educ. Res. Pract. 2013, 14, 214-222
27. Chiu, M.-H.; Chou, C.-C.; Liu, C.-J. Dynamic Processes of Conceptual Change: Analysis of Constructing Mental Models of Chemical Equilibrium J. Res. Sci. Teach. 2002, 39 (8) 688-712
28. Artdej, R.; Ratanaroutai, T.; Coll, R. K.; Thongpanchang, T. Thai Grade 11 Students' Alternative Conceptions for Acid-Base Chemistry Res. Sci. Technol. Educ. 2010, 28 (2) 167-183
29. Lin, J.-W.; Chiu, M.-H. Exploring the Characteristics and Diverse Sources of Students' Mental Models of Acids and Bases Int. J. Sci. Educ. 2007, 29 (6) 771-803
30. Kraft, A.; Strickland, A. M.; Bhattacharyaa, G. Reasonable Reasoning: Multi-Variate Problem Solving in Organic Chemistry Chem. Educ. Res. Pract. 2010, 11 (4) 281-292
31. McClary, L.; Talanquer, V. College Chemistry Students' Mental Models of Acids and Acid Strength J. Res. Sci. Teach. 2011, 48 (4) 396-413
32. Vosniadou, S.; Brewer, W. F. Mental Models of the Day/Night Cycle Cognit. Sci. 1994, 18 (1) 123-183
33. McClary, L.; Talanquer, V. Heuristic Reasoning in Chemistry: Making Decisions about Acid Strenght Int. J. Sci. Educ. 2011, 33 (10) 1433-1454
34. McClary, L.; Bretz, S. L. Development and Assessment of a Diagnostic Tool To Identify Organic Chemistry Students' Alternative Conceptions Related to Acid Strength Int. J. Sci. Educ. 2012, 34 (5) 2317-2341
35. Nyachwaya, J. M.; Mohamed, A.-R.; Roehrig, G. H.; Wood, N. B.; Kern, A. L.; Schneider, J. L. The Development of an Open-Ended Drawing Tool: An Alternative Diagnostic Tools for Assessing Students' Understanding of the Particulate Nature of Matter Chem. Educ. Res. Pract. 2011, 12 (2) 121-132
36. Stains, M.; Escriu-Sune, M.; Alvarez de Santizo, M. L. M.; Sevian, H. Assessing Secondary and College Students' Implicit Assumptions about the Particulate Nature of Matter: Development and Validation of the Structure and Motion of Matter Survey J. Chem. Educ. 2011, 88 (10) 1359-1365
37. Luxford, C. J.; Bretz, S. L. Development of the Bonding Representations Inventory to Identify Student Misconceptions about Covalent and Ionic Bonding Representations Chem. Educ. 2014, 91 (3) 312-320
38. Treagust, D. F.; Chandrasegaran, A. L.; Crowley, J.; Yung, B. H.; Cheong, I. P.-A.; Othman, J. Evaluating Students' Understanding of Kinetic Particle Theory concepts Relating to the State of Matter, Changes of State, and Diffusion: A Cross-National Study Int. J. Sci. Math. Educ. 2010, 8 (1) 141-164
39. Adadan, E.; Savasci, F. An Analysis of 16-17-year-old Students' Understanding of Solution Chemistry Concepts Using a Two-Tier Diagnostic Instrument Int. J. Sci. Educ. 2012, 34 (4) 513-544
40. Brandriet, A. R.; Bretz, S. L. The Development of the Redox Concept Inventory as a Measure of Students' Symbolic and Particulate Redox Understandings and Confidence J. Chem. Educ. 2014, 91 (8) 1132-1144
41. Özmen, H. Determination of Students' Alternative Conceptions about Chemical Equilibrium: A Review of Research and the Case of Turkey Chem. Educ. Res. Pract. 2008, 9 (3) 225-233
42. Voska, K. W.; Heikkinen, H. W. Identification and Analysis of Student Conceptions Used To Solve Chemical Equilibrium Problems J. Res. Sci. Teach. 2000, 37 (2) 160-176
43. Sia, D. T.; Treagust, D. F.; Chandrasegaran, A. L. High School Students' Proficiency and Confidence Levels in Displaying their Understanding of Basic Electrolysis Concepts Int. J. Sci. Math. Educ. 2012, 10 (6) 1325-1345
44. Bretz, S. L.; Linenberger, K. J. Development of the Enzyme-Substrate Interactions Concept Inventory Biochem. Mol. Biol. Educ. 2012, 40 (4) 229-233
45. Caleon, I.; Subramaniam, R. Do Students Know What They Know and What They Don't Know? Using a Four-Tier Diagnostic Test to Assess the Nature of Students' Alternative Conceptions Res. Sci. Educ. 2010, 40 (3) 313-337
46. Treagust, D. F. Development and Use of Diagnostic Tests to Evaluate Students' Misconceptions in Science Int. J. Sci. Educ. 1988, 10 (2) 159-169
47. Grove, N. P.; Hershberger, J. W.; Bretz, S. L. Impact of a Spiral Curriculum on Student Attrition and Learning Chem. Educ. Res. Pract. 2008, 9 (2) 157-162
48. Ding, L.; Beichner, R. Approaches to Data Analysis of Multiple-Choice Questions Phys. Rev. Spec. Top.-Phys. Educ. Res. 2009, 5, 020103-1-020103-17
49. Hake, R. R. Interactive-Engagement versus Traditional Methods: A Six-Thousand-Student Survey of Mechanics Test Data for Introductory Physics Courses Am. J. Phys. 1998, 66 (1) 64-74
50. Peter, J. P. Reliability: A Review of Psychometric Basics and Recent Marketing Practices J. Mark. Res. 1979, 16 (1) 6-17
51. Maeyer, J.; Talanquer, V. The Role of Intuitive Heuristics in Students' Thinking: Ranking Chemical Substances Sci. Educ. 2010, 94, 963-984
52. Taber, K. S. College Students' Conceptions of Chemical Stability: The Widespread Adoption of a Heuristic Rule out of Context and Beyond its Range of Application Int. J. Sci. Educ. 2009, 31, 1333-1358
53. Chi, M. T. H.; Feltovich, P. J.; Glaser, R. Categorization and Representation of Physics Problems by Experts and Novices Cognitive Sci. 1981, 5 (2) 121-152
54. Bhattacharyya, G.; Bodner, G. M. 'It Gets Me to the Product:' How Students Propose Organic Mechanisms J. Chem. Educ. 2005, 82 (9) 1402-1407
55. Ferguson, R.; Bodner, G. M. Making Sense of the Arrow-Pushing Formalism among Chemistry Majors Enrolled in Organic Chemistry Chem. Educ. Res. Pract. 2008, 9 (2) 102-113
56. Bretz, S. L. Navigating the Landscape of Assessment J. Chem. Educ. 2012, 89 (6) 689-691
57. Holme, T. A. Assessment Data and Decision Making in Teaching J. Chem. Educ. 2011, 88 (8) 1017-1017
58. Zoller, U. Science Education for Global Sustainability: What is Necessary for Teaching, Learning, and Assessment Strategies? J. Chem. Educ. 2012, 89 (3) 297-300
59. Smith, K. C.; Nakhleh, M. B.; Bretz, S. L. An Expanded Framework for Analyzing General Chemistry Tests Chem. Educ. Res. Pract. 2010, 11 (3) 147-153
60. Arjoon, J. A.; Xu, X.; Lewis, J. E. Understanding the State of the Art for Measurement in Chemistry Education Research: Examining the Psychometric Evidence J. Chem. Educ. 2013, 90 (5) 536-545
61. Gerlach, K.; Trate, J.; Blecking, A.; Geissinger, P.; Murphy, K. Valid and Reliable Assessments to Measure Scale Literacy of Students in Introductory College Chemistry Courses J. Chem. Educ. 2014, 10.1021/ed400471a
62. Cronbach, L. J. Coefficient Alpha and the Internal Structure of Tests Psychometrika 1951, 16 (3) 297-334
63. Cronbach, L. J. Test Reliability: Its Meaning and Determination Psychometrika 1947, 12 (1) 1-16
64. Bretz, S. L. Designing Assessment Tools to Measure Students' Conceptual Knowledge of Chemistry. In Tools of Chemistry Education Research; Bunce, D.,; Cole, R., Eds.; American Chemical Society: Washington, D.C., 2014; pp 155-168.
65. Lewis, S. E.; Lewis, J. E. The Same or Not the Same: Equivalence as an Issue in Educational Research J. Chem. Educ. 2005, 82 (9) 1408-1412
66. Cooper, M. M.; Underwood, S. M.; Hilley, C. Z. Development and Validation of the Implicit Information from Lewis Structures Instrument (IILSI): Do Students Connect Structures with Properties? Chem. Educ. Res. Pract. 2012, 13, 195-200
67. Salkind, N. J. Getting It Right Every Time: Reliability and Its Importance. In Tests & Measurement for People Who (Think They) Hate Tests & Measurement; SAGE Publications: Thousand Oaks, CA, 2006; pp 37-62.
68. Streiner, D. L. Starting at the Beginning: An Introduction to Coefficient Alpha and Internal Consistency J. Pers. Assess. 2003, 80 (1) 99-103
69. Segars, A. Assessing the Unidimensionality of Measurement: A Paradigm and Illustration within the Context of Information Systems Research Omega 1997, 25 (1) 107-121
70. Adams, W. K.; Wieman, C. E. Development and Validation of Instruments to Measure Learning of Expert-like Thinking Int. J. Sci. Educ. 2011, 33 (9) 1289-1312
71. Rochester, C. H.; Rossall, B. Steric Hindrance and Acidity. Part 3. Enthalpies and Entropies of Ionization of Phenols in Methanol Trans. Faraday Soc. 1969, 65, 1004-1013
72. Parsons, G. H.; Rochester, C. H. Enthalpies and Entropies of Ionization of 4-Substituted Phenols in Methanol + Water Mixtures J. Chem. Soc., Faraday Trans. 1 1975, 71, 1069-1082
73. Dunning, D. The Dunning-Kruger Effect: On Being Ignorant of One's Own Ignorance. In Advances in Experimental Social Psychology; Olson, J.M.; Zanna, M.P., Eds.; Elsevier Academic Press: San Diego, CA, 2011; Vol. 44, pp 247-296.
74. Brandriet, A. R.; Bretz, S. L. Measuring 'Meta-Ignorance' through the Lens of Confidence: Examining Students' Redox Misconceptions about Oxidation Numbers, Charge, and Electron Transfer Chem. Educ. Res. Pract. 2014, 15 (4) 729-746
75. Hammer, D. Misconceptions or P-Prims: How May Alternative Perspectives of Cognitive Structure Influence Instructional Perceptions and Intentions J. Learn. Sci. 1996, 5 (2) 97-127