A meta-analysis of the effects of audience response systems (clicker-based technologies) on cognition and affect

Computers and Education

Volumn 94, Issue , 2016, Pages 102-119

  Hunsu, Nathaniel J ^a   Adesope, Olusola ^a   Bayly, Dan James ^a  

^a WASHINGTON STATE UNIVERSITY   (United States)

Author keywords

Audience response system; Clickers; Meta analysis; Student engagement; Student response system

Indexed keywords

ENGINEERING EDUCATION;

AUDIENCE RESPONSE SYSTEMS; CLICKERS; META ANALYSIS; STUDENT ENGAGEMENT; STUDENT-RESPONSE SYSTEM;

STUDENTS;

EID: 84949595561     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2015.11.013     Document Type: Article

References (119)

1. L. Abrahamson A brief history of networked classrooms: effects, cases, pedagogy, and implications D.A. Banks, Audience response systems in higher education 2006 Information Science Publishing Hershey, PA 1 25
2. A.O. ∗Agbatogun Developing learners' second language communicative competence through active learning: clickers or communicative approach? Educational Technology & Society 17 2 2013 257 269
3. R. ∗Amstelveen The effect of "clickers" on attendance in an introductory statistics course: An action research study Doctoral dissertation 2013 Capella University Minnesota
4. L.S. Anderson, A.F. Healy, J.A. Kole, and L.E. Bourne Jr. Conserving time in the classroom: the clicker technique Quarterly Journal of Experimental Psychology 64 8 2011 1457 1462
5. L.S. Anderson, A.F. Healy, J.A. Kole, and L.E. Bourne Jr. The clicker technique: cultivating efficient teaching and successful learning Applied Cognitive Psychology 27 2 2013 222 234
6. T. Andre, and A. Thieman Level of adjunct question, types of feedback, and learning concepts by reading Contemporary Educational Psychology 13 3 1988 296 307
7. K. Anthis Is it the clicker, or is it the question? untangling the effects of student response system use Teaching of Psychology 38 3 2011 189 193
8. R.A. ∗Bartsch, and W. Murphy Examining the effects of an electronic classroom response system on student engagement and performance Journal of Educational Computing Research 44 1 2011 25 33
9. T.J. ∗Bear An action research study on the effect of interactive technology and active learning on student performance Doctoral dissertation 2013 Capella University Minnesota
10. I. Beatty Transforming student learning with classroom communication systems EDUCAUSE Center Applied Research (ECAR) Research Bulletin 2004 3 2004 1 13
11. I.D. Beatty, W.J. Gerace, W.J. Leonard, and R.J. Dufresne Designing effective questions for classroom response system teaching American Journal of Physics 74 1 2006 31 39
12. G. Bergtrom Clicker sets as learning objects Interdisciplinary Journal of Knowledge and Learning Objects 2 2006 105 110
13. R.M. Bernard, P.C. Abrami, Y. Lou, E. Borokhovski, C.A. Wade, L. Wozney, and et al. How does distance education compare with classroom instruction? a meta-analysis of the empirical literature Review of Educational Research 74 2004 379 439
14. J. ∗Berry Technology support in nursing education: clickers in the classroom Nursing Education Perspectives 30 5 2009 295 298
15. L. Blasco-Arcas, I. Buil, B. Hernández-Ortega, and F.S. Sese Using clickers in class. The role of interactivity, active collaborative learning and engagement in learning performance Computer & Education 62 2013 102 110
16. E. ∗Blood, and R. Neel Using student response systems in lecture-based instruction: does it change student engagement and learning? Journal of Technology and Teacher Education 16 3 2008 375 383
17. E. ∗Bojinova, and J.N. Oigara Teaching and learning with clickers: are clickers good for students? Interdisciplinary Journal of E-Learning and Learning Objects 7 2011 169 184
18. M. Borenstein, L.V. Hedges, P.T. Higgins, and R. Rothstein Introduction to meta-analysis 2008 John Wiley Hoboken, NJ
19. M. ∗Brady, H. Seli, and J. Rosenthal "Clickers" and metacognition: a quasi-experimental comparative study about metacognitive self-regulation and use of electronic feedback devices Computers & Education 65 2013 56 63
20. R.A. Burns Information impact and factors affecting recall Paper presented at Annual National Conference on Teaching Excellence and Conference of Administrators, Austin, TX 1985, May
21. D.L. Butler, and P.H. Winne Feedback and self-regulated learning: a theoretical synthesis Review of Educational Research 65 3 1995 245 281
22. J. ∗Cain, E.P. Black, and J. Rohr An audience response system strategy to improve student motivation, attention, and feedback American Journal of Pharmaceutical Education 73 2 2009 1 7
23. J.E. Caldwell Clickers in the large classroom: current research and best-practice tips Life Sciences Education 6 1 2007 9 20
24. C. ∗Carnaghan, and A. Webb Investigating the effects of group response systems on learning outcomes and satisfaction in accounting education 2005 Retrieve from http://accounting.uwaterloo.ca/research/publications/carnaghan-webb-aaa-working-paper.pdf
25. E. ∗Chan, and L. Knight Clicking with your audience Communications in Information Literacy 4 2 2010 192 201
26. P.D. Chen, R. Gonyea, and G. Kuh Learning at a distance: engaged or not Journal of Online Education 4 3 2008 Retrieved from http://innovateonline.info/index.php?view=article&id= 438&action=login
27. R.M. Conrad, and J.A. Donaldson Engaging the online learner: Activities and resources for creative instruction 2004 John Wiley & Sons San Francisco, CA
28. H.M. Cooper, and L.V. Hedges The handbook of research synthesis 1994 The Russell Sage Foundation New York
29. H.L. ∗Copeland, M.G. Hewson, J.K. Stoller, and D.L. Longworth Making the continuing medical education lecture effective Journal of Continuing Education in the Health Professions 18 4 1998 227 234
30. K. ∗Crossgrove, and K.L. Curran Using clickers in non-majors and majors-level biology courses: student opinion, learning, and long-term retention of course material CBE-Life Sciences Education 7 1 2008 146 154
31. J.C. De Gagne The impact of clickers in nursing education: a review of literature Nurse Education Today 31 2011 34 40
32. M. ∗Doucet, A. Vrins, and D. Harvey Effect of using an audience response system on learning environment, motivation and long-term retention, during case-discussions in a large group of undergraduate veterinary clinical pharmacology students Medical Teacher 31 12 2009 e570 e579
33. D. Duncan Clickers in the classroom: How to enhance science teaching using classroom response systems 2005 Addison Wesley and Benjamin Cummings New York
34. P.K. Dunn, A. Richardson, C. McDonald, and F. Oprescu Instructor perceptions of using a mobile-phone-based free classroom response system in first-year statistics undergraduate courses International Journal of Mathematical Education in Science and Technology 43 8 2012 1041 1056
35. S. Duval, and R. Tweedie Trim and fill: a simple funnel plot based method of testing and adjusting for publication bias in meta-analysis Biometrics 50 2000 455 463
36. C. Elliot Using a personal response system in economics teaching International Review of Economics Education 1 1 2003 80 86
37. M. ∗Fallon, and S.L. Forrest High-tech versus low-tech instructional strategies: a comparison of clickers and handheld response cards Technology and Teaching 38 3 2011 194 198
38. C. Fies, and J. Marshall Classroom response systems: a review of the literature Journal of Science Education and Technology 15 1 2006 100 109
39. D. ∗Filer Everyone's answering: using technology to increase classroom participation Nursing Education Perspectives 31 4 2010 247 250
40. J.D. Finn, and C.M. Achilles Tennessee's class size study: findings, implications, misconceptions Educational Evaluation and Policy Analysis 21 2 1999 97 109
41. K.A. ∗FitzPatrick, K.E. Finn, and J. Campisi Effect of personal response systems on student perception and academic performance in courses in a health sciences curriculum AJP: Advances in Physiology Education 35 3 2011 280 289
42. C. ∗Fortner-Wood, L. Armistead, A. Marchand, and F.B. Morris The effects of student response systems on student learning and attitudes in undergraduate psychology courses Teaching of Psychology 40 1 2013 26 30
43. J.A. Fredricks, P.C. Blumenfeld, and A.H. Paris School engagement: potential of the concept, state of the evidence Review of Educational Research 74 1 2004 59 109
44. S. ∗Freeman, E. O'Connor, J.W. Parks, M. Cunningham, D. Hurley, D. Haak, and et al. Prescribed active learning increases performance in introductory biology CBE-Life Sciences Education 6 2 2007 132 139
45. G.V. Glass, B. McGaw, and M.L. Smith Meta-analysis in social research 1981 Sage Publications Beverly Hills, CA
46. E.C. ∗Graeff, M. Vail, A. Maldonado, M. Lund, S. Galante, and G. Tataronis Click it: assessment of classroom response systems in physician assistant education Journal of Allied Health Spring 40 1 2011 e1 e5
47. C. Graham, T. Tripp, L. Seawright, and G. Joeckel Empowering or compelling reluctant participators using audience response systems Active Learning in Higher Education 8 3 2007 233 258
48. B. Guzzetti, T.E. Snyder, G.V. Glass, and W.S. Gamas Promoting conceptual change in science: a comparative meta-analysis of instructional interventions from reading education and science education Reading Research Quarterly 28 2 1993 117 159
49. R.R. Hake Interactive-engagement versus traditional methods: a six-thousand-student survey of mechanics text data for introductory physics courses American Journal of Physics 66 1 1998 64 74
50. J. Hattie, and H. Timperley The power of feedback Review of Educational Research 77 1 2007 81 112
51. L.V. Hedges, and I. Olkin Statistical methods for meta-analysis 1985 Academic Press Orlando, FL
52. J.P.T. Higgins, and S.G. Thompson Quantifying heterogeneity in a meta-analysis Statistics in Medicine 21 2002 1539 1558
53. S. ∗Jones, J. Crandall, J. Vogler, and D. Robinson Classroom response systems facilitate student accountability, readiness, and learning Journal of Computing Research 49 2 2013 155 177
54. E. Judson, and D. Sawada Audience response systems: insipid contrivances or inspiring tools? D.A. Banks, Audience response systems in higher education 2006 Information Science Publishing Hershey, PA 26 39
55. H. ∗Kang, M. Lundeberg, B. Wolter, R. delMas, and C.F. Herreid Gender differences in student performance in large lecture classrooms using personal response systems ("clickers") with narrative case studies Learning, Media and Technology 37 1 2012 53 76
56. S. ∗Karaman Effects of audience response systems on student achievement and long-term retention Social Behavior and Personality: An International Journal 39 10 2011 1431 1439
57. R.H. Kay, and A. LeSage Examining the benefits and challenges of using audience response systems: a review of the literature Computer & Education 53 3 2009 819 827
58. S.M. ∗Keough Clickers in the classroom: a review and a replication Journal of Management Education 36 6 2012 822 847
59. C.-H. ∗Ke, H.-M. Sun, and Y.-C. Yang Effects of user and system characteristics on perceived usefulness and perceived ease of use of the web-based classroom response system Turkish Online Journal of Educational Technology-TOJET 11 3 2012 128 143
60. J. ∗Kiefer The effect of electronic response systems: Relationship between perceptions and class performance and difference by gender and academic ability Doctoral dissertation 2013 Ball State University Indiana
61. J.K. ∗Knight, and W.B. Wood Teaching more by lecturing less Cell Biology Education 4 4 2005 298 310
62. K. Krause, and H. Coates Students' engagement in first-year university Assessment and Evaluation in Higher Education 33 5 2008 493 505
63. K.H. ∗Lim Addressing the multiplication makes bigger and division makes smaller misconceptions via prediction and clickers International Journal of Mathematical Education in Science and Technology 42 8 2011 1081 1106
64. M. Limon On the cognitive conflict as an instructional strategy for conceptual change: a critical appraisal Learning an Instruction 11 2001 357 380
65. Y.-C. ∗Lin, T.-C. Liu, and C.-C. Chu Implementing clickers to assist learning in science lectures: the clicker-assisted conceptual change model Australasian Journal of Educational Technology 27 6 2011 979 996
66. M.W. Lipsey, and D.B. Wilson Practical meta-analysis Applied social research methods series Vol. 49 2001 Sage Thousand Oaks, CA
67. M.A. ∗Lundeberg, H. Kang, B. Wolter, R. delMas, N. Armstrong, B. Borsari, and et al. Context matters: increasing understanding with interactive clicker case studies Educational Technology Research and Development 59 5 2011 645 671
68. L. ∗Lynch The effect of clickers on math achievement in 11th grade mathematics Doctoral dissertation 2013 Walden University Minneapolis, Minnesota
69. N. ∗Marin The impact of a classroom performance system on learning gains in a biology course for science majors Doctoral dissertation 2013 Florida International University Miami, Florida
70. R.E. Mayer Forward transfer of different reading strategies evoked by test-like events in mathematics text Journal of Educational Psychology 67 1975 165 169
71. R.E. Mayer, and P. Chandler When learning is just a click away: does simple user interaction foster deeper understanding of multimedia messages? Journal of Educational Psychology 93 2001 390 397
72. R.E. ∗Mayer, A. Stull, K. DeLeeuw, K. Almeroth, B. Bimber, D. Chun, and et al. Clickers in college classrooms: fostering learning with questioning methods in large lecture classes Contemporary Educational Psychology 34 1 2009 51 57
73. M.R. ∗McNally The effects of classroom response systems on student learning and engagement Doctoral dissertation 2012 Duquesne University Pittsburgh, PA
74. D. Moher, A. Liberati, J. Tetzlaff, D.G. Altman The PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement PLoS Med 6 7 2009 e1000097 10.1371/journal.pmed.1000097
75. S. ∗Morgan The effect of using clickers in higher education science classrooms Doctoral dissertation 2012 The University of Alabama Tuscaloosa, Alabama
76. B. ∗Morling, M. McAuliffe, L. Cohen, and T.M. DiLorenzo Efficacy of personal response systems ("clickers") in large, introductory psychology classes Teaching of Psychology 35 1 2008 45 50
77. L. Naismith, P. Lonsdale, G. Vavoula, and M. Sharples Report 11: Literature review in mobile technologies and learning 2004 NESTA Futurelab Bristol, UK Retrieve from http://www2.futurelab.org.uk/resources/documents/lit-reviews/Mobile-Review.pdf
78. R.G. Orwin A fail-safe N for effect size in meta-analysis Journal of Educational Statistics 8 1983 157 159
79. E.T. Pascarella, and P.T. Terenzini How college affects students: A third decade of research 2005 Jossey-Bass San Francisco
80. C.B. ∗Paschal Formative assessment in physiology teaching using a wireless classroom communication system Advances in Physiology Education 26 4 2002 299 308
81. B. Patterson, J. Kilpatrick, and E. Woebkenberg Evidence for teaching practice: the impact of clickers in a large classroom environment Nurse Education Today 30 7 2010 603 607
82. B. ∗Petersohn Classroom performance systems, library instruction, and instructional design: a pilot study Portal: Libraries and the Academy 8 3 2008 313 324
83. C.R. Poirier, and R.S. Feldman Promoting active learning using individual response technology in large introductory psychology classes Teaching of Psychology 34 3 2007 194 196
84. A. ∗Pradhan, D. Sparano, and C.V. Ananth The influence of an audience response system on knowledge retention: an application to resident education American Journal of Obstetrics and Gynecology 193 5 2005 1827 1830
85. A.M. Richardson, P.K. Dunn, C. McDonald, and F. Oprescu Crisp: an instrument for assessing student perceptions of classroom response systems Journal of Science Education and Technology 24 4 2015 432 447
86. E. Riggs, and C. Gholar Strategies that promote student engagement: Unleashing the desire to learn 2009 Corwin Press Thousand Oaks, CA
87. G.E. Robinson Synthesis of research on the effects of class size Educational Leadership 47 1990 80 90
88. H.L. Roediger, and A.C. Butler The critical role of retrieval practice in long-term retention Trends in Cognitive Science 15 2011 20 27
89. H.L. Roediger, and J.D. Karpicke The power of testing memory: basic research and implications for educational practice Perspectives in Psychological Science 1 3 2006 181 210
90. R. Rosenthal Writing meta-analytic reviews Psychological Bulletin 118 1995 183 192
91. J.I. Rotgans, and H.G. Schmidt Situational interest and academic achievement in the active-learning classroom Learning and Instruction 21 2011 58 67
92. E.I. ∗Rubio, M.J. Bassignani, M.A. White, and W.E. Brant Effect of an audience response system on resident learning and retention of lecture material American Journal of Roentgenol 190 6 2008 319 322
93. R.M. Ryan, and E.L. Deci Intrinsic and extrinsic motivations: classic definitions and new directions Contemporary Educational Psychology 25 2000 54 67
94. N. Sageman, and R.E. Mayer Forward transfer of different reading strategies evoked by adjunct questions in science text Journal of Educational Psychology 79 1987 189 191
95. T.E. ∗Schackow, M. Chavez, L. Loya, and M. Friedman Audience response system: effect on learning in family medicine residents Family Medicine-Kansas City- 36 7 2004 496 504
96. D.M. ∗Shaffer, and M.J. Collura Evaluating the effectiveness of a personal response system in the classroom Teaching of Psychology 36 4 2009 273 277
97. V. Simpson, and M. Oliver Electronic voting systems for lectures then and now: a comparison of research and practice Australasian Journal of Educational Technology 23 2 2007 187 208
98. J.P. Smith, A.A. diSessa, and J. Roschelle Misconceptions reconceived: a constructivist analysis of knowledge in transition The Journal of the Learning Sciences 3 2 1993 115 163
99. M.K. Smith, W.B. Wood, W.K. Adams, C. Wieman, J.K. Knight, N. Guild, and et al. Why peer discussion improves student performance on in-class concept questions Science 323 5910 2009 122 124
100. J. ∗Steeley Clicking on the learning light for community college students Doctoral dissertation 2012 Capella University Minneapolis, MN
101. J.A. Sterne, and M. Egger Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis Journal of Clinical Epidemiology 54 10 2001 1046 1055
102. H.A. ∗Stoddard, and C.A. Piquette A controlled study of improvements in student exam performance with the use of an audience response system during medical school lectures Academic Medicine 85 2010 S37 S40
103. J.R. ∗Stowell, and J.M. Nelson Benefits of electronic audience response systems on student participation, learning, and emotion Teaching of Psychology 34 4 2010 253 258
104. J. ∗Stowell, T. Oldham, and D. Bennett Using student response systems ("clickers") to combat conformity and shyness Teaching of Psychology 37 2 2010 135 140
105. R. Sullivan Principles for constructing good clicker questions: going beyond rote learning and stimulating active engagement with course content Journal of Educational Technology Systems 37 3 2009 335 347
106. A.L. ∗Sutherlin, G.R. Sutherlin, and U. Akpanudo The effect of clickers in university science courses Journal of Science Education and Technology 22 5 2013 651 666
107. C. Tekkaya Misconceptions as barriers to understanding biology Hacettepe Universitesi Egitim Dergisi 23 2002 259 266
108. V. Tinto Leaving college: Rethinking the causes and cures of student attrition 2nd ed. 1993 University of Chicago Press Chicago
109. A. ∗Tregonning, D. Doherty, J. Hornbuckle, and J. Dickinson The audience response system and knowledge gain: a prospective study Medical Teacher 34 4 2012 e269 e274
110. L.C. ∗Ueltschy An exploratory study of integrating interactive technology into the marketing curriculum Journal of Marketing Education 23 1 2001 63 72
111. M. Uhari, M. Renko, and H. Soini Experiences of using an interactive audience response system in lectures BMC Medical 2003 Retrieved from http://www.biomedcentral.com/1472-6920/3/12
112. S.,R. ∗Welch Clicker effectiveness on nursing students' level of knowledge as evidenced by exam performance Doctoral dissertation 2011 University of Alabama Tuscaloosa
113. D. Willis, and J. Willis Doing task-based teaching 2007 Oxford University Press Oxford
114. E. Wit Who wants to be. the use of a personal response system in statistics teaching MSOR Connections 3 2 2003 14 20
115. M. Wolff, M.J. Wagner, S. Poznanski, J. Schiller, and S. Santen Not another boring lecture: engaging learners with active learning techniques The Journal of Emergency Medicine 48 1 2015 85 93
116. S.A. ∗Yourstone, H.S. Kraye, and G. Albaum Classroom questioning with immediate electronic response: do clickers improve learning? Decision Sciences Journal of Innovative Education 6 1 2008 75 88
117. C. Zhao, and G.D. Kuh Adding value: learning communities and student engagement Research in Higher Education 45 2 2004 115 138
118. Y. ∗Zhonggen, and C. Liu The influence of clickers use of metacognition and learning outcomes in college English classroom International Journal of Information and Communication Technology Education 10 2 2014 50 61
119. E. Zhu Teaching with clickers Occasional Paper No. 22 2008 Center for Research on Learning and Teaching, University of Michigan Ann Arbor, MI Retrieved from http://www.crlt.umich.edu/publinks/occasional.php