A Historical Investigation into Item Formats of ACS Exams and Their Relationships to Science Practices

Journal of Chemical Education

Volumn 92, Issue 11, 2015, Pages 1798-1806

  Brandriet, Alexandra ^a   Reed, Jessica J ^a   Holme, Thomas ^a  

^a IOWA STATE UNIVERSITY   (United States)

Author keywords

General Public; History Philosophy; Testing Assessment

Indexed keywords

EID: 84946943863     PISSN: 00219584     EISSN: 19381328     Source Type: Journal    
DOI: 10.1021/acs.jchemed.5b00459     Document Type: Article

References (48)

1. National Research Council. A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas; Committee on a Conceptual Framework for New K-12 Science Education Standards. Board on Science Education, Division of Behavioral and Social Sciences and Education; The National Academies Press: Washington, DC, 2012. http://www.nap.edu/openbook.php?record-id=13165 (accessed April 2015)
2. Achieve, Inc. Next Generation Science Standards; National Research Council: Washington, DC, 2013. http://www.nextgenscience.org/next-generation-science-standards (accessed April 2015).
3. National Research Council. Developing Assessments for the Next Generation Science Standards; Committee on Developing Assessments of Science Proficiency in K-12. Board on Testing and Assessment and Board on Science Education; Pellegrino, J. W., Wilson, M. R., Koenig, J. A., Beatty, A. S., Eds.; Division of Behavioral and Social Sciences and Education; The National Academies Press: Washington, DC, 2014. http://www.nap.edu/download.php?record-id=18409 (accessed April 2015)
4. Osborne, J. Teaching Scientific Practices: Meeting the Challenge of Change J. Sci. Teach. Educ. 2014, 25 (2) 177-196 10.1007/s10972-014-9384-1
5. Cooper, M. M. Chemistry and the Next Generation Science Standards J. Chem. Educ. 2013, 90 (6) 679-680 10.1021/ed400284c
6. Novak, J. D. Learning, Creating, and Using Knowledge: Concept Maps as Facilitative Tools in Schools and Corporations, 2 nd ed.; Routledge: New York, NY, 2010.
7. Undergraduate Professional Education in Chemistry: ACS Guidelines and Evaluation Procedures for Bachelors Degree Programs. http://www.acs.org/content/dam/acsorg/about/governance/committees/training/2015-acs-guidelines-for-bachelors-degree-programs.pdf (accessed June, 2015).
8. Wenzel, T. J.; McCoy, A. B.; Landis, C. R. An Overview of the Changes in the 2015 ACS Guidelines for Bachelors Degree Programs J. Chem. Educ. 2015, 92 (6) 965-968 10.1021/acs.jchemed.5b00265
9. DeBoer, G. E. A History of Ideas in Science Education: Implications for Practice, 1 st ed.; Teachers College Press: New York, NY, 1991; pp 1-296.
10. Ashford, T. A. A Brief History of Objective Tests J. Chem. Educ. 1972, 49 (6) 420-423 10.1021/ed049p420
11. Ashford, T. A. Contributions of the ACS Examinations Committee to Chemical Education J. Chem. Educ. 1965, 42 (9) 496-501 10.1021/ed042p496
12. Ashford, T. A. Otto M. Smith-A Tribute J. Chem. Educ. 1979, 56 (12) 804 10.1021/ed056p804
13. Smith, O. M.; Hendricks, B. C.; Kirk, R. E.; Phelan, E. W.; Powers, S. R.; Reed, R. D.; Wade, F. B. The 1935-36 College Chemistry Testing Program: Report of the Committee on Examinations and Tests J. Chem. Educ. 1937, 14 (5) 229-231 10.1021/ed014p229
14. Phelan, E. W. The 1936-37 College Chemistry Testing Program J. Chem. Educ. 1937, 14 (12) 586-590 10.1021/ed014p586
15. Foster, L. S. The 1939-1940 College Chemistry Testing Program J. Chem. Educ. 1941, 18 (4) 159-164 10.1021/ed018p159
16. Ashford, T. A. The 1940-1941 College Chemistry Testing Program J. Chem. Educ. 1942, 19 (3) 116-121 10.1021/ed019p116
17. Hendricks, B. C.; Smith, O. M. Service Test for Chemistry Sch. Sci. Math. 1935, 35 (5) 488-491 10.1111/j.1949-8594.1935.tb10884.x
18. Ashford, T. A.; Shanner, W. M. Are We Teaching Our Students to Distinguish Between Fact and Theory? J. Chem. Educ. 1940, 17 (7) 306-309 10.1021/ed017p306
19. Ashford, T. A.; Shanner, W. M. Objective Test Items of the Recognition Type that Test Reasoning and Minimize Guessing J. Chem. Educ. 1942, 19 (2) 86-89 10.1021/ed019p86
20. Ashford, T. A. The Problem of Chemistry in General Education J. Chem. Educ. 1942, 19 (6) 260-263 10.1021/ed019p260
21. Ashford, T. A. The College Chemistry Test in the Armed Forces Institute J. Chem. Educ. 1944, 21 (8) 386-392 10.1021/ed021p386
22. Smith, O. M. Examination and Test Conference: University of Chicago; Examination and Testing Committee Memo; ACS Examination and Testing Committee: Chicago, IL, 1941.
23. Holme, T. Assessment and Quality Control in Chemistry Education J. Chem. Educ. 2003, 80 (6) 594-596 10.1021/ed080p594
24. Emenike, M. E.; Schroeder, J. D.; Murphy, K. L.; Holme, T. A Snapshot of Chemistry Faculty Members Awareness of Departmental Assessment Efforts. Assess. Update 2011, 23 (4), 1-2, 14-16.
25. Emenike, M. E.; Holme, T. A. Classroom Response Systems Have Not "Crossed the Chasm": Estimating Numbers of Chemistry Faculty Who Use Clickers J. Chem. Educ. 2012, 89 (4) 465-469 10.1021/ed200207p
26. Emenike, M. E.; Schroeder, J.; Murphy, K.; Holme, T. Results from a National Needs Assessment Survey: A View of Assessment Efforts within Chemistry Departments J. Chem. Educ. 2013, 90 (5) 561-567 10.1021/ed200632c
27. Emenike, M.; Raker, J. R.; Holme, T. Validating Chemistry Faculty Members Self-Reported Familiarity with Assessment Terminology J. Chem. Educ. 2013, 90 (9) 1130-1136 10.1021/ed400094j
28. Raker, J. R.; Emenike, M. E.; Holme, T. A. Using Structural Equation Modeling to Understand Chemistry Faculty Familiarity of Assessment Terminology: Results from a National Survey J. Chem. Educ. 2013, 90 (8) 981-987 10.1021/ed300636m
29. Raker, J. R.; Holme, T. A. Investigating Faculty Familiarity with Assessment Terminology by Applying Cluster Analysis to Interpret Survey Data J. Chem. Educ. 2014, 91 (8) 1145-1151 10.1021/ed500075e
30. Linenberger, K. J.; Holme, T. A. Results of a National Survey of Biochemistry Instructors to Determine the Prevalence and Types of Representations Used during Instruction and Assessment J. Chem. Educ. 2014, 91 (6) 800-806 10.1021/ed400201v
31. Linenberger, K. J.; Holme, T. A. Biochemistry Instructors Views toward Developing and Assessing Visual Literacy in Their Courses J. Chem. Educ. 2015, 92 (1) 23-31 10.1021/ed500420r
32. Holme, T. A.; Luxford, C. J.; Brandriet, A. Defining Conceptual Understanding in General Chemistry J. Chem. Educ. 2015, 10.1021/acs.jchemed.5b00218
33. Reed, J. J.; Holme, T. A. The Role of Non-Content Goals in the Assessment of Chemistry Learning. In Innovative Uses of Assessments for Teaching and Research; Kendhammer, L. K.; Murphy, K., Eds.; ACS Symposium Series 1182; American Chemical Society: Washington, DC, 2014; pp 147-160.
34. Bodner, G. Statistical Analysis of Multiple-Choice Exams J. Chem. Educ. 1980, 57 (3) 188-190 10.1021/ed057p188
35. Lukhele, R.; Thissen, D.; Wainer, H. On the Relative Value of Multiple-Choice, Constructed Response, and Examinee-Selected Items on Two Achievement Tests Journal of Educational Measurement. 1994, 31 (3) 234-250 10.1111/j.1745-3984.1994.tb00445.x
36. Reja, U.; Manfreda, K. L.; Hlebec, V.; Vehovar, V. Open-ended vs. Close-ended Questions in Web Questionnaires Dev. Appl. Stat. 2003, 19, 159-177
37. Martinez, M. A Comparison of Multiple-Choice and Constructed Figural Response Items Journal of Educational Measurement. 1991, 28 (2) 131-145 10.1111/j.1745-3984.1991.tb00349.x
38. Campbell, M. L. Multiple-Choice Exams and Guessing: Results from a One-Year Study of General Chemistry Tests Designed to Discourage Guessing J. Chem. Educ. 2015, 92, 1194 10.1021/ed500465q
39. Rotfeld, H. Are We Teachers or Job Trainers? AMS Q. 1998, 2, 2
40. Martinez, M. E. Cognition and the Question of Test Item Format Educational Psychologist. 1999, 34 (4) 207-218 10.1207/s15326985ep3404-2
41. Kuechler, W. L.; Simkin, M. G. Why is Performance on Multiple-Choice Tests and Constructed-Response Tests Not More Closely Related? Theory and an Empirical Test Decision Sciences Journal of Innovative Education 2010, 8 (1) 55-73 10.1111/j.1540-4609.2009.00243.x
42. Reed, J. J. Analyzing the Role of Science Practices in General Chemistry Courses and Assessments. PhD Dissertation, Iowa State University, 2015.
43. Underwood, S. M.; Cooper, M. M.; Krajcik, J.; Caballero, D.; Ebert-May, D. Designing a Rubric to Characterize Assessments; presented at the 248th ACS National Meeting and Exposition, San Francisco, CA, August 10-14th, 2014.
44. Raker, J. R.; Holme, T. A. A Historical Analysis of the Curriculum of Organic Chemistry Using ACS Exams as Artifacts J. Chem. Educ. 2013, 90 (11) 1437-1442 10.1021/ed400327b
45. Towns, M. H. Guide to Developing High-Quality, Reliable, and Valid Multiple-Choice Assessments J. Chem. Educ. 2014, 91 (9) 1426-1431 10.1021/ed500076x
46. Haladyna, T. M.; Downing, S. M.; Rodriguez, M. C. A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment Appl. Meas. Educ. 2002, 15 (3) 309-334 10.1207/S15324818AME1503-5
47. Kuhn, T. S. The Structure of Scientific Revolutions; The University of Chicago Press: Chicago, IL, 1962.
48. Ashford, T. A. The Testing Program of the Division of Chemical Education of the American Chemical Society: A Committee Report J. Chem. Educ. 1948, 25 (5) 280-290 10.1021/ed025p280