Direct measures of digital information processing and communication skills in primary education: Using item response theory for the development and validation of an ICT competence scale

Computers and Education

Volumn 76, Issue , 2014, Pages 168-181

  Aesaert, Koen ^a   Van Nijlen, Daniël ^b   Vanderlinde, Ruben ^a   Van Braak, Johan ^a  

^a GHENT UNIVERSITY   (Belgium)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Elementary education; Evaluation methodologies; ICT competences; Item response theory; Lifelong learning

Indexed keywords

DATA PROCESSING;

ELEMENTARY EDUCATION; EVALUATION METHODOLOGIES; ICT COMPETENCES; ITEM RESPONSE THEORY; LIFE LONG LEARNING;

COMMUNICATION;

EID: 84898623388     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2014.03.013     Document Type: Article

References (71)

1. A.A.H. Abswoude, L.A. van der Ark, and K. Sijtsma A comparative study of test data dimensionality assessment procedures under nonparametric IRT models Ap (Pubitemid 38142851)
2. K. Aesaert, R. Vanderlinde, J. Tondeur, and J. van Braak The content of educational technology curricula: a cross-curricular state of the art ETR & D-Educational Technology Research and Development 61 1 2013 131 151
3. M. Allen, R.C. Noel, B.M. Rienzi, and D.J. McMillin Outcomes assessment handbook 2002 California State University Bakersfield Bakersfield, California
4. American Association of School Librarians (AASL), and the Association for Educational Communications and Technology (AECT) Information literacy standards for student learning 1998 American Library Association Chicago
5. K. Ananiadou, and M. Claro 21st Century skills and competences for new millennium learners in OECD countries Paper presented at the new millennium learners conference - 21st Century skills and competencies 2009, September Brussels
6. Association of College and Research Libraries (ACRL) Information literacy competency standards for higher education 2000 Retrieved 03.10.13, from http://www.ala.org/acrl/standards-/informationliteracycompetency
7. F.B. Baker The basics of item response theory 2nd ed. 2001 ERIC Clearinghouse on Assessment and Evaluation College Park, MD
8. F.B. Baker, and S.H. Kim Item response theory. Parameter estimation techniques 2nd ed. 2004 Marcel Dekker New York
9. B. Barron, C. Kennedy Martin, and E. Roberts Sparking self-sustained learning: report on a design experiment to build technological fluency and bridge divides International Journal of Technology and Design Education 17 1 2007 75 105 (Pubitemid 46405858)
10. T. Bouffard, H. Markovits, C. Vezeau, M. Boisvert, and C. Dumas The relation between accuracy of self-perception and cognitive development British Journal of Educational Psychology 68 3 1998 321 330 (Pubitemid 128655630)
11. S. Brand-Gruwel, I. Wopereis, and Y. Vermetten Information problem solving by experts and novices: analysis of a complex cognitive skill Computers in Human Behavior 21 3 2005 487 508 (Pubitemid 40034574)
12. U. Bunz, C. Curry, and W. Voon Perceived versus actual computer-email-web fluency Computers in Human Behavior 23 5 2007 2321 2344 (Pubitemid 46483984)
13. A. Calvani, A. Fini, M. Ranieri, and P. Picci Are young generations in secondary school digitally competent? A study on Italian teenagers Computers & Education 58 2 2012 797 807
14. C.T. Chen, and W.C. Wang Effects of ignoring item interaction on item parameter estimation and detection of interacting items Applied Psychological Measurement 31 5 2007 388 411
15. W.H. Chen, and D. Thissen Local independence indexes for item pairs using item response theory Journal of Educational and Behavioral Statistics 22 3 1998 265 289
16. D.R. Compeau, and C.A. Higgins Computer self-efficacy: development of a measure and initial test MIS Quarterly 19 2 1995 189 211
17. R.J. De Ayala The theory and practice of item response theory 2009 The Guilford Press New York
18. H.C. Doran The information function for the one-parameter logistic model: is it reliability? Educational and Psychological Measurement 65 5 2005 665 675
19. M.O. Edelen, and B.B. Reeve Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement Quality of Life Research 16 1 2007 5 18 (Pubitemid 47036924)
20. Educational Testing Service (ETS) Digital transformation: A framework for ICT literacy A report of the International ICT Literacy Panel 2002 ETS, Center for Global Assessment Princeton
21. M.C. Edwards, and M.O. Edelen Special topics in item response theory R.E. Millsap, A. Maydeu-Olivares, The SAGE handbook of quantitative methods in psychology 2009 SAGE Publications London 178 199
22. M.B. Eisenberg Information literacy: essential skills for the information age Journal of Library & Information Technology 28 2 2005 39 47
23. M.B. Eisenberg, and D. Johnson Learning and teaching information technology computer skills in context Eric Digest 2002 ED465377. Retrieved 13.08.13, from http://www.ericdigests.org/2003-1/skills.htm
24. S.E. Embretson, and S.P. Reise Item response theory for psychologists 2000 Lawrence Erlbaum Associates Mahwah, New Jersey
25. European Commission Key competences for lifelong learning. European reference framework 2007 Office for Official Publications of the European Communities Luxembourg
26. J. Fraillon, and J. Ainley The IEA international study of computer and information literacy (ICILS) 2010 Retrieved from http://icils2013.acer.edu.au/ wpcontent/uploads/examples-/ICILS-Detailed-Project-Description.pdf
27. J.P. Gee A situated-sociocultural approach to literacy and technology E.A. Baker, The new literacies. Multiple perspectives on research and practices 2010 The Guilford Press New York 165 193
28. K. Hakkarainen, L. Ilomäki, L. Lipponen, H. Muukkonen, M. Rahikainen, and T. Tuominen Students' skills and practices of using ICT: results of a national assessment in Finland Computers & Education 34 2 2000 103 117
29. R.K. Hambleton, H. Swaminathan, and H.J. Rogers Fundamentals of item response theory 1991 Sage Publications New Bury, California
30. E. Hargittai, and S. Shafer Differences in actual and perceived online skills: the role of gender Social Science Quarterly 87 2 2006 432 448 (Pubitemid 43751401)
31. International Society for Technology in Education (ISTE) National educational technology standards for students 2nd ed. 2007 International Society for Technology in Education Eugene, OR
32. M. Ito, S. Baumer, M. Bittanti, D. Boyd, R. Cody, and B. Herr-Stephenson et al. Hanging out, messing around, and geeking out. Kids living and learning with new media The John D. and Catherine T. MacArthur Foundation reports on digital media and learning 2009 MIT Press Cambridge, Massachusetts
33. M. Ito, H. Horst, M. Bittanti, D. Boyd, B. Herr-Stephenson, and P.G. Lange et al. Living and learning with new media: Summary of findings from the digital youth project The John D. and Catherine T. MacArthur Foundation reports on digital media and learning 2008 MIT Press Cambridge, Massachusetts
34. I.R. Katz Testing information literacy in digital environments: ETS's iSkills assessment Information Technologies and Libraries 26 3 2007 3 12
35. R. Kozma Comparative analysis of policies for ICT in education J. Voogt, G. Knezek, International handbook of information technology in primary and secondary education 2008 Springer New York 1083 1096
36. E. Kuiper Teaching web literacy in primary education (Unpublished doctoral dissertation) 2007 Free University Amsterdam, The Netherlands
37. E. Kuiper, M. Volman, and J. Terwel The web as an information resource in K-12 education: strategies for supporting students in searching and processing information Review of Educational Research 75 3 2005 285 328 (Pubitemid 41442064)
38. A.D. Madden, N.J. Ford, D. Miller, and P. Levy Children's use of the internet for information seeking. What strategies do they use and what factors affect their performance? Journal of Documentation 62 6 2006 744 761 (Pubitemid 44704540)
39. G.M. Marakas, M.Y. Yi, and R.D. Johnson The multilevel and multifaceted character of computer self-efficacy: toward clarification of the construct and an integrative framework for research Information Systems Research 9 2 1998 126 163
40. L. Markauskaite Toward an integrated analytical framework of information and communications technology literacy: from intended to implemented and achieved dimensions Information Research - An International Electronic Journal 11 3 2006 Retrieved from http://informationr.net/ir/11-3/paper252.html
41. L. Markauskaite Exploring the structure of trainee teachers' ICT literacy: the main components and relationships between general cognitive and technical capabilities Educational Technology Research & Development 55 6 2007 547 572
42. A. Martin Literacies for the digital age: preview of part 1 A. Martin, D. Madigan, Digital literacies for learning 2006 Facet Publishing London 3 25
43. M. Meelissen Computer attitudes and competencies among primary and secondary school students J. Voogt, G. Knezek, International handbook of information technology in primary and secondary education 2008 Springer New York 381 395
44. S. Messick The interplay of evidence and consequences in the validation of performance assessments Educational Researcher 23 2 1994 13 23
45. C. Monseur, A. Baye, D. Lafontaine, and V. Quittre PISA test format assessment and the local independence assumption IERI monograph series: Issues and methodologies in large-scale assessments, 4 2011 IEA/ETS Research Institute (IERI) Hamburg, Germany
46. North Central Regional Educational Laboratory (NCREL) enGauge 21st century skills: Literacy in the digital age 2003 North Central Regional Educational Laboratory Naperville, IL
47. T.C. Oshima, and S.B. Morris Raju's differential functioning of items and tests (DFIT) Educational Measurement: Issues and Practice 27 3 2008 43 50
48. S.J. Osterlind Constructing test items: Multiple-choice, constructed-response, performance and other formats 2nd ed. 2002 Kluwer Academic Publishers Dordrecht
49. M. Papastergiou, V. Gerodimos, and P. Antoniou Multimedia blogging in physical education: effects on student knowledge and self-efficacy Computers and Education 57 3 2012 1998 2010
50. M. Pommerich, and D.O. Segal Local dependence in an operational CAT: diagnosis and implications Journal of Educational Measurement 45 3 2008 201 223
51. M. Prensky Digital natives, digital immigrant On the Horizon 9 5 2001 15 24
52. M. Puustinen, and J.F. Rouet Learning with new technologies: help seeking and information searching revisited Computers & Education 53 4 2009 1014 1019
53. N.S. Raju, W.J. van der Linden, and P.F. Fleer An IRT-based internal measure of test bias with applications for differential item functioning Applied Psychological Measurement 19 4 1995 353 368 (Pubitemid 126093662)
54. M.D. Reckase A linear logistic multidimensional model for dichotomous item response data W.J. van der Linden, R.K. Hambleton, Handbook of modern item response theory 1997 Springer New York 271 286
55. C.A. Reid, S.A. Kolakowsky-Hayner, A.N. Lewis, and A.J. Armstrong Modern psychometric methodology: applications of item response theory Rehabilitation Counseling Bulletin 50 3 2007 177 188
56. R. Savolainen Network competence and information seeking on the internet. From definitions towards a social cognitive model Journal of Documentation 58 2 2002 221 226
57. M.M. Somerville, G.W. Smith, and A.S. Macklin The ETS iSkills™ assessment: a digital age tool The Electronic Library 26 2 2008 158 171
58. C.A. Stone, and B. Zhang Assessing goodness of fit of item response theory models: a comparison of traditional and alternative procedures Journal of Educational Measurement 40 4 2003 331 352 (Pubitemid 38483767)
59. R. Tate A comparison of selected empirical methods for assessing the structure of responses to test items Applied Psychological Measurement 27 3 2003 159 202
60. R. Tezza, A.C. Bornia, and D.F. de Andrade Measuring web usability using item response theory: principles. Features and opportunities Interacting with Computers 23 2 2011 167 175
61. M.J. Tsai Online information searching strategy inventory (OISSI): a quick version and a complete version Computers & Education 53 2 2009 473 483
62. M.J. Tsai, and C.C. Tsai Information searching strategies in web-based science learning: the role of internet self-efficacy Innovations in Education and Teaching International 40 1 2003 43 50
63. M.J. Tsai, and C.C. Tsai Junior high school students' internet usage and self-efficacy: a re-examination of the gender gap Computers & Education 54 4 2010 1182 1192
64. A.J.A.M. Van Deursen, and S. van Diepen Information and strategic internet skills of secondary students: a performance test Computers & Education 63 2013 218 226
65. R. Vanderlinde, J. van Braak, and R. Hermans Educational technology on a turning point: curriculum implementation in Flanders and challenges for schools ETR & D Educational Technology Research and Development 57 4 2009 573 584
66. S. Varma Preliminary item statistics using point biserial correlation and p value 2006 Educational Data System, Inc. Retrieved 20.08.13, from http://www.eddata.com/resources/publications/-EDS-Point-Biserial.pdf
67. J. Voogt IT and curriculum processes: dilemmas and challenges J. Voogt, G. Knezek, International handbook of information technology in primary and secondary education 2008 Springer New York 117 132
68. J. Voogt, and N. Pareja Roblin A comparative analysis of international frameworks for 21st century competences: implications for national curriculum policies Journal of Curriculum Studies 44 3 2012 299 321
69. J. Wirth Computer-based tests: alternatives for test and item design J. Hartig, E. Klieme, D. Leutner, Assessment of competencies in educational contexts 2008 Hogrefe & Huber Cambridge 235 252
70. W.M. Yen Scaling performance assessments: strategies for managing local item dependence Journal of Educational Measurement 30 3 1993 187 213
71. W.M. Yen, and A.R. Fitzpatrick Item response theory R.L. Brennan, Educational measurement 4th ed. 2006 American Council on Education and Praeger Publishers Westport 111 153