Development of an Assessment Tool to Measure Students' Meaningful Learning in the Undergraduate Chemistry Laboratory

Journal of Chemical Education

Volumn 92, Issue 7, 2015, Pages 1149-1158

  Galloway, Kelli R ^a   Bretz, Stacey Lowery ^a  

^a MIAMI UNIVERSITY   (United States)

Author keywords

Assessment; Chemistry Education Research; First Year Undergraduate; Hands On Learning; Laboratory Instruction; Learning Theories; Organic Chemistry; Second Year Undergraduate

Indexed keywords

EID: 84949056131     PISSN: 00219584     EISSN: 19381328     Source Type: Journal    
DOI: 10.1021/ed500881y     Document Type: Article

References (46)

1. Elliott, M. J.; Stewart, K. K.; Lagowski, J. J. The Role of the Laboratory in Chemistry Instruction J. Chem. Educ. 2008, 85, 145-149
2. National Research Council. Discipline-Based Education Research: Understanding and Improving Learning in Undergraduate Science and Engineering; National Academies Press: Washington, DC, 2012.
3. Hofstein, A.; Lunetta, V. N. The Role of the Laboratory in Science Teaching: Neglected Aspects of Research Rev. Educ. Res. 1982, 52 (2) 201-17
4. Hofstein, A.; Lunetta, V. N. The Laboratory in Science Education: Foundations for the Twenty-first Century Sci. Educ. 2004, 88, 28-54
5. Nakhleh, M. B.; Polles, J.; Malina, E. Learning Chemistry in a Laboratory Environment. In Chemical Education: Towards Research-based Practice, Gilbert, J. K.; De Jong, R.; Justi, D. F.; Treagust, J. H.; Van Driel, J. H., Eds.; Kluwer: Dordrecht, Netherlands, 2002; pp 69-94.
6. Reid, N.; Shah, I. The Role of Laboratory Work in University Chemistry Chem. Educ. Res. Pract. 2007, 8, 172-185
7. Sevian, H.; Fulmer, G. W. Student Outcomes from Innovations in Undergraduate Chemistry Laboratory Learning: A Review of Projects Funded by the US National Science Foundation Between 2000-2008 Educación Química 2012, 23, 149-161
8. NSTA Board of Directors. "NSTA Position Statement,The Integral Role of Laboratory Investigations in Science Instruction". http://www.nsta.org/about/positions/laboratory.aspx (accessed Feb 2015).
9. Hawkes, S. J. Chemistry Is Not a Laboratory Science J. Chem. Educ. 2004, 81, 1257
10. Hilosky, A.; Sutman, F.; Schmuckler, J. Is Laboratory Based Instruction in Beginning College-Level Chemistry Worth the Effort and Expense? J. Chem. Educ. 1998, 75, 100-104
11. Bretz, S. L.; Fay, M.; Bruck, L. B.; Towns, M. H. What Faculty Interviews Reveal About Meaningful Learning in the Undergraduate Chemistry Laboratory J. Chem. Educ. 2013, 90, 281-88
12. Bruck, L. B.; Towns, M. H.; Bretz, S. L. Faculty Perspectives of Undergraduate Chemistry Laboratory: Goals and Obstacles to Success J. Chem. Educ. 2010, 87, 1416-24
13. Bruck, A. D.; Towns, M. H. Development, Implementation, and Analysis of a National Survey of Faculty Goals for Undergraduate Chemistry Laboratory J. Chem. Educ. 2013, 90, 685-693
14. Cooper, M. M.; Sandi-Urena, S. Design and Validation of an Instrument to Assess Metacognitive Skillfullness in Chemistry Problem Solving J. Chem. Educ. 2009, 86, 240-245
15. Grove, N.; Bretz, S. L. CHEMX: An Instrument to Assess Students' Cognitive Expectations for Learning Chemistry J. Chem. Educ. 2007, 84, 1524-1529
16. Bauer, C. Beyond "Student Attitudes": Chemistry Self-Concept Inventory for Assessment of the Affective Component of Student Learning J. Chem. Educ. 2005, 82, 1864-1870
17. Bauer, C. Attitude Towards Chemistry: A Semantic Differential Instrument for Assessing Curriculum Impact J. Chem. Educ. 2008, 85, 1440-1445
18. Xu, X.; Lewis, J. E. Refinement of a Chemistry Attitude Measure for College Students J. Chem. Educ. 2011, 88, 561-568
19. Brandriet, A. R.; Xu, X.; Bretz, S. L.; Lewis, J. E. Diagnosing Changes in Attitude in First Year College Chemistry Students with a Shortened Version of Bauer's Semantic Differential Chem. Educ. Res. Pract. 2011, 12, 271-278
20. Barbera, J.; Adam, W. K.; Wieman, C. E.; Perkins, K. K. Modifying and Validating the Colorado Learning Attitudes about Science Survey for Use in Chemistry J. Chem. Educ. 2008, 85, 1435-1439
21. Bowen, C. W. Development and Score Validation of a Chemistry Laboratory Anxiety Instrument (CLAI) for College Chemistry Students Educ. Psych. Meas. 1999, 59, 171-185
22. Russell, C. B. Development and Evaluation of a Research-Based Undergraduate Laboratory Curriculum. Ph.D. Dissertation. Purdue University, 2006.
23. Bretz, S. L. Navigating the Landscape of Assessment J. Chem. Educ. 2012, 89, 689-691
24. Finster, D. C. Developmental Instruction: Part 1. Perry's Model of Intellectual Development J. Chem. Educ. 1989, 66, 659-661
25. Finster, D. C. Development Instruction: Part II. Application of the Perry Model to General Chemistry J. Chem. Educ. 1991, 68, 752-756
26. Towns, M. H. Kolb for Chemists: David A. Kolb and Experimental Learning Theory J. Chem. Educ. 2001, 78, 1107
27. Novak, J. D. Learning, Creating, and Using Knowledge; Taylor & Francis Group: New York, NY, 2010.
28. Novak, J. D. Human Constructivism: A Unification of Psychological and Epistemological Phenomena in Meaning Making J.Constructivist Psych. 1993, 6, 167-193
29. Bretz, S. L. Novak's Theory of Education: Human Constructivism and Meaningful Learning J. Chem. Educ. 2001, 78, 1107-1116
30. Mezirow, J. Transformative Dimensions of Adult Education; Jossey-Bass: San Francisco, CA, 1991.
31. Wink, D. J. Reconstructing Student Meaning: A Theory of Perspective Transformation J. Chem. Educ. 2001, 78, 1107
32. Herron, J. D. Piaget for Chemists J. Chem. Educ. 1975, 52, 146-150
33. Bunce, D. M. Does Piaget Still Have Anything to Say to Chemists? J. Chem. Educ. 2001, 78, 1107
34. Fabrigar, L. R.; Wegener, D. T. Exploratory Factor Analysis; Oxford University Press: New York, NY, 2012.
35. Cronbach, L. J. Coefficient Alpha and the Internal Structure of Tests Psychometrika 1951, 16, 297-334
36. Bretz, S. L.; McClary, L. Students' Understanding of Acid Strength: How Meaningful Is Reliability When Measuring Alternative Conceptions? J. Chem. Educ. 2015, 92 (2) 212-219
37. Ferguson, G. On the Theory of Test Discrimination Psychometrika 1949, 1, 61-68
38. Hankins, M. Questionnaire Discrimination: (Re)-Introducing Coefficient δ BMC Medical Research Methodology 2007, 7, 19
39. American Educational Research Association; American Psychological Association; National Council on Measurement in Education; Joint Committee on Standards for Educational and Psychological Testing (US) Standards for Educational and Psychological Testing; American Educational Research Association: Washington, DC, 1999.
40. Arjoon, J. A.; Xu, X.; Lewis, J. E. Understanding the State of the Art for Measurement in Chemistry Education Research: Examining the Psychometric Evidence J. Chem. Educ. 2013, 90, 536-545
41. Marsh, H. W.; Scalas, L. F.; Nagengast, B. Longitudinal Tests for Competing Factor Solutions for the Rosenberg Self-Esteem Scale: Traits, Ephemeral Artifacts, and Stable Response Scales Psych. Assess. 2010, 22, 366-381
42. Cohen, B. Explaining Psychological Statistics, 3 rd ed.; Wiley: New York, 2008; pp 528-547.
43. Cohen, J. Eta-Squared and Partial Eta-Squared in Fixed Factor ANOVA Designs Educ. Psych. Meas. 1973, 33, 107-112
44. Levine, T. R.; Hullett, C. R. Eta Squared, Partial Eta Squared, and Misreporting of Effect Size in Communication Research Human Commun. Res. 2002, 28, 612-625
45. Brandriet, A. R.; Ward, R. M.; Bretz, S. L. Modeling meaningful learning in chemistry using structural equation modeling Chem. Educ. Res. Pract. 2013, 14, 421-430
46. Chan, J. K. Y.; Bauer, C. F. Identifying at-risk students in general chemistry via cluster analysis of affective characteristics J. Chem. Educ. 2014, 91, 1417-1425