Developing a test of scientific literacy skills (TOSLS): Measuring undergraduates' evaluation of scientific information and arguments

CBE Life Sciences Education

Volumn 11, Issue 4, 2012, Pages 364-377

  Gormally, Cara ^a   Brickman, Peggy ^b   Lut, Mary ^c  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b School of Biology   (United States)

^c UNIVERSITY OF GEORGIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; DEMOGRAPHY; EDUCATION; FEMALE; HUMAN; INFORMATION PROCESSING; KNOWLEDGE; LEARNING; MALE; METHODOLOGY; REPRODUCIBILITY; SCIENCE; STATISTICS; STUDENT; UNIVERSITY;

DATA COLLECTION; DEMOGRAPHY; EDUCATIONAL MEASUREMENT; FACULTY; FEMALE; HUMANS; KNOWLEDGE; LEARNING; MALE; REPRODUCIBILITY OF RESULTS; SCIENCE; STUDENTS;

EID: 84871356679     PISSN: None     EISSN: 19317913     Source Type: Journal    
DOI: 10.1187/cbe.12-03-0026     Document Type: Article

References (81)

1. American Association for the Advancement of Science (AAAS) (1990). Science for All Americans, New York: Oxford University Press.
2. AAAS (1993). Benchmarks for Science Literacy, New York: Oxford University Press.
3. AAAS (2010). Vision and Change: A Call to Action, Washington, DC.
4. American Educational Research Association (1999). Standards for Educational and Psychological Testing, Washington, DC: American Psychological Association.
5. Anderson DL, Fisher KM, Norman GJ (2002).Development and evaluation of the Conceptual Inventory of Natural Selection. J Res Sci Teach 39, 952-978.
6. Andrews TM, Leonard MJ, Colgrove CA, Kalinowski ST (2011). Active learning NOT associated with student learning in a random sample of college biology courses. CBE Life Sci Educ 10, 394-405.
7. Bauer MW, Allum N, Miller S (2007). What can we learn from 25 years of PUS survey research? Public Underst Sci 16, 79-95.
8. Bialek W, Botstein D (2004). Introductory science and mathematics education for 21st-century biologists. Science 303, 788-790.
9. Bowen GM, Roth W-M, McGinn MK (1999). Interpretations of graphs by university biology students and practicing scientists: toward a social practice view of scientific representation practices. J Res Sci Teach 36, 1020-1043.
10. Brand-Gruwel S, Wopereis I, Walraven A(2009).Adescriptivemodel of information problem solving while using Internet. Comput Educ 53, 1207-1217.
11. Braten I, Stromso HI, Salmeron L (2011). Trust and mistrust when students read multiple information sources about climate change. Learn Instr 21, 180-192.
12. Bray Speth E, Momsen JL, Moyerbrailean GA, Ebert-May D, Long TM, Wyse S, Linton D (2010). 1, 2, 3, 4: infusing quantitative literacy into introductory biology. CBE Life Sci Educ 9, 323-332.
13. Brem SK, Russell J, Weems L (2011). Science on the Web: student evaluations of scientific arguments. Discourse Process 32, 191-213.
14. Brickman P, Gormally C, Francom G, Jardeleza SE, Schutte VGW, Jordan C, Kanizay L (2012). Media-savvy scientific literacy: projectbased instruction to develop critical evaluation skills. AmBiol Teach 74, 374-379.
15. Britt MA, Aglinskas C (2002). Improving students' ability to identify and use source information. Cogn Instr 20, 485-522.
16. Bybee RW (1993). Reforming Science Education: Social Perspectives and Personal Reflections, New York: Teachers College Press.
17. Chevalier CD, Ashley DC, Rushin JW (2010). Acquisition and retention of quantitative communication skills in an undergraduate biology curriculum: long-term retention results. J Coll Sci Teach 39, 64-70.
18. Cho K-L, Jonassen DH (2002). The effects of argumentation scaffolds on argumentation and problem solving. Educ Technol Res Dev 50, 5-22.
19. Coil D, Wenderoth MP, Cunningham M, Dirks C (2010). Teaching the process of science: faculty perceptions and an effectivemethodology. CBE Life Sci Educ 9, 524-535.
20. Colon-Berlingeri M, Borrowes PA (2011). Teaching biology through statistics: application of statistical methods in genetics and zoology courses. CBE Life Sci Educ 10, 259-267.
21. Cook WD (1977). Adult Literacy Education in the United States, Newark, DE: International Reading Association.
22. Crocker L, Algina J (2008). Introduction to Classical and Modern Test Theory, Mason, OH: Cengage Learning.
23. Cronbach L (1951). Coefficient alpha and the internal structure of tests. Psychometrika 16, 297-334.
24. D'Avanzo C (2008). Biology concept inventories: overview, status, and next steps. Bioscience 58, 1-7.
25. DeBoer GE (2000). Scientific literacy: another look at its historical and contemporarymeanings and its relationship to science education reform. J Res Sci Teach 37, 582-601.
26. DeHaan RL (2005). The impending revolution in undergraduate science education. J Sci Educ Technol 14, 253-269.
27. Dunlap WP, Cortina JM, Vaslow JB, Burke MJ (1996). Meta-analysis of experiments with matched groups or repeated measures designs. Psychol Methods 1, 170-177.
28. Ebel R (1965). Measuring Educational Achievement, Englewood Cliffs, NJ: Prentice Hall.
29. Ebert-May D, Derting TL, Hodder J, Momsen JL, Long TM, Jardeleza SE (2011). What we say is not what we do: effective evaluation of faculty professional development programs. Bioscience 61, 550-558.
30. Facione PA (1991). Using the California Critical Thinking Skills Test in Research, Evaluation, and Assessment, Millbrae, CA: California Academic Press.
31. Feldt LS (1993). The relationship between the distribution of item difficulties and test reliability. Appl Meas Educ 6, 37-48.
32. Fencl HS (2010). Development of students' critical-reasoning skills through content-focused activities in a general education course. J Coll Sci Teach 39, 56-62.
33. Fox S (2006). Online Health Search 2006, Pew Charitable Trust.
34. Garvin-Doxas K, Klymkowsky MW (2008). Understanding randomness and its impact on student learning: lessons learned from building the Biology Concept Inventory (BCI). CBE Life Sci Educ 7, 227-233.
35. Gross LJ (2004). Interdisciplinarity and the undergraduate biology curriculum: finding a balance. Cell Biol Educ 3, 85-87.
36. Holbrook J, Rannikmae M (2009). The meaning of scientific literacy. Int J Environ Sci Educ 4, 275-288.
37. Horrigan J (2006). The Internet as a Resource for News and Information about Science. www.pewtrusts.org/our_work_report_detail.aspx?id=21142 (accessed 13 January 2011).
38. Hoskins SG (2010). "But if it's in the newspaper, doesn't that mean it's true?" Developing critical reading and analysis skills by evaluating newspaper science with C.R.E.A.T.E. Am Biol Teach 72, 415-420.
39. Jenkins EW (1990). Scientific literacy and school science education. School Sci Rev 71, 43-51.
40. Karsai I, KampisG(2010). The crossroads between biology andmathematics: the scientific method as the basis of scientific literacy. Bioscience 60, 632-638.
41. Koballa T, Kemp A, Evans R (1997). The spectrumof scientific literacy. Sci Teach 64, 27-31.
42. Kuiper E, Volman M, Terwel J (2005). The Web as an information resource in K-12 education: strategies for supporting students in searching and processing information. Rev Educ Res 75, 285-328.
43. Kutner M, Greenberg E, Jin Y, Boyle B, Hsu Y, Dunleavy E (2007). Literacy in Everyday Life:Results fromthe 2003 NationalAssessment of AdultLiteracy(NCES2007-480), Washington, DC: NationalCenter for Education Statistics, U.S. Department of Education.
44. Labov JB (2004). The challenges and opportunities for improving undergraduate science education through introductory courses. Cell Biol Educ 3, 212-214.
45. Lawson AE (1978). The development and validation of a classroom test of formal reasoning. J Res Sci Teach 15, 11-24.
46. Lemke M, Sen A, Pahlke E, Partelow L, Miller D, Williams T, Kastberg D, Jocelyn L (2004). International Outcomes of Learning in Mathematics Literacy and Problem Solving: PISA Results from the U.S. Perspective, Washington, DC: National Center for Education Statistics.
47. Maienschein J et al. (1998). Scientific literacy. Science 281, 917-917.
48. MaKinster JG, Beghetto RA, Plucker JA (2002).Why can't I findNewton's third law? Case studies of students' use of theWeb as a science resource. J Sci Educ Technol 11, 155-172.
49. Marsteller P, de Pillis L, Findley A, Joplin K, Delesko J, Nelson K, Thompson K (2010). Toward integration: from quantitative biology to mathbio-biomath? CBE Life Sci Educ 9, 165-171.
50. Meinwald J, Hildebrand JG (eds.) (2010). Science and the Educated American:ACoreComponent of Liberal Education, Cambridge,MA: American Academy of Arts and Sciences.
51. Millar R (1996). Towards a science curriculum for public understanding. School Sci Rev 77, 7-18.
52. Millar R, Osborne J, Nott M (1998). Science education for the future. School Sci Rev 80, 19-24.
53. Miller JD (2007). The impact of college science courses for non-science majors on adult science literacy. Paper presented at the Critical Role of College Science Courses for Non-Majors, San Francisco, CA, February 18, 2007.
54. National Academy of Sciences (1997). Introducing the National Science Education Standards, Washington, DC: Center for Science, Mathematics, and Engineering Education.
55. National Institute of Mathematical and Biological Sciences (2012). NIMBioS website. http://nimbios.org/education (accessed 25 June 2012).
56. National Research Council (NRC) (1996).National Science Education Standards, Washington, DC: National Academies Press.
57. NRC (2003). BIO2010: Transforming Undergraduate Education for Future Research Biologists, Washington, DC: National Academies Press.
58. Newton P, Driver R, Osborne J (1999). The place of argumentation in the pedagogy of school science. Int J Sci Educ 21, 553-576.
59. Norris SP, Phillips LM, Smith ML, Guilbert SM, Stange DM, Baker JJ, Weber AC (2008). Learning to read scientific text: do elementary school commercial reading programs help? Sci Educ 92, 765-798.
60. Organisation for Economic Co-operation and Development (2003). The PISA 2003 Assessment Framework-Mathematics, Reading, Science and Problem Solving Knowledge and Skills.
61. Osborne J (2010).Arguing to learn in science: the role of collaborative, critical discourse. Science 328, 463-466.
62. Osterlind SJ (2010). Modern Measurement: Theory, Principles, and Applications of Mental Appraisal, 2nd ed., Upper Saddle River, NJ: Pearson.
63. Picone C, Rhode J, Hyatt L, Parshall T (2007). Assessing gains in undergraduate students' abilities to analyze graphical data. Teach Issues Exp Ecol 5 (July 2007):Research #1. http://tiee.esa.org/vol/v5/research/picone/abstract.html (accessed 3 May 2010).
64. Preece J, Janvier C (1992). A study of the interpretation of trends in multiple curve graphs of ecological situations. School Sci Math 92, 299-306.
65. Quitadamo IJ, Faiola CL, Johnson JE, Kurtz MJ (2008). Communitybased inquiry improves critical thinking in general education biology. CBE Life Sci Edu 7, 327-337.
66. Ryder J (2001). Identifying science understanding for functional scientific literacy. Stud Sci Educ 36, 1-44.
67. Sadler PM (1998). Psychometricmodels of student conceptions in science: reconciling qualitative studies and character-driven assessment instruments. J Res Sci Teach 35, 265-296.
68. Semsar K, Knight JK, Birol G, Smith MK (2011). The Colorado Learning Attitudes about Science Survey (CLASS) for use in biology. CBE Life Sci Educ 10, 268-278.
69. Shi J, Wood WB, Martin JM, Guild NA, Vicens Q, Knight JK (2010). A diagnostic assessment for introductory molecular and cell biology. CBE Life Sci Educ 9, 453-461.
70. Smith MK, Wood WB, Knight JK (2008).The GeneticsConcept Assessment: a new concept inventory for gauging student understanding of genetics. CBE Life Sci Educ 7, 422-430.
71. Steen LA (1997). Why Numbers Count: Quantitative Literacy for Tomorrow's America, New York: College Entrance Examination Board.
72. Sundre D (2003). Assessment of Quantitative Reasoning to Enhance Educational Quality. Paper presented at the American Educational Research Association Meeting, Chicago, IL, April 2003.
73. Sundre D (2008). The Scientific Reasoning Test, Version 9 (SR-9) Test Manual, Harrisonburg, VA: Center for Assessment and Research Studies.
74. Sundre DL, Thelk A, Wigtil C (2008). The Quantitative Reasoning Test, Version 9 (QR-9) Test Manual, Harrisonburg, VA: Center for Assessment and Research Studies.
75. Tanner K, Allen D (2005). Approaches to biology teaching and learning: understanding the wrong answers-teaching toward conceptual change. Cell Biol Educ 4, 112-117.
76. Tsui C-Y, Treagust D (2010). Evaluating secondary students' scientific reasoning in genetics using a two-tier diagnostic instrument. Int J Sci Educ 32, 1073-1098.
77. Uno GE, Bybee RW (1994). Understanding the dimensions of biological literacy. Bioscience 71, 553-557.
78. Walraven A, Brand-Gruwel S, Boshuizen HPA (2009). How students evaluate information and sources when searching the World Wide Web for information. Comput Educ 52, 234-246.
79. Weber E (2009). Quantifying student learning: how to analyze assessment data. Bull Ecol SocAm90, 501-511.
80. White B, Stains M, Escriu-Sune M, Medaglia E, Rostamnjad L, Chinn C, SevianH(2011). Anovel instrument for assessing students' critical thinking abilities. J Coll Sci Teach 40, 102-107.
81. Willis GB (2005).Cognitive Interviewing:ATool for Improving Questionnaire Design, Thousand Oaks, CA: Sage.