Validity of kit-build method for assessment of learner-build map by comparing with manual methods

IEICE Transactions on Information and Systems

Volumn E101D, Issue 4, 2018, Pages 1141-1150

  Wunnasri, Warunya ^a   Pailai, Jaruwat ^a   Hayashi, Yusuke ^a   Hirashima, Tsukasa ^a  

^a HIROSHIMA UNIVERSITY   (Japan)

Author keywords

Concept map assessment method; Kit build concept map; Validity

Indexed keywords

TEACHING;

AUTOMATIC ASSESSMENT; CONCEPT MAPS; KIT-BUILD CONCEPT MAPS; MANUAL METHODS; STRONG CORRELATION; UNIVERSITY STUDENTS; VALIDITY;

LEARNING SYSTEMS;

EID: 85044735808     PISSN: 09168532     EISSN: 17451361     Source Type: Journal    
DOI: 10.1587/transinf.2017EDP7177     Document Type: Article

References (34)

1. J.D. Novak and D. Musonda, "A twelve-year longitudinal study of science concept learning, " American Educational Research Journal, vol.28, no.1, pp.117-153, 1991.
2. D.P. Ausubel, J.D. Novak, and H. Hanesian, Educational psychology: A cognitive view, Rinehart and Winston, New York, 1978.
3. J.D. Novak and A.J. Cãnas, Technical report IHMC CmapTools, Institute for Human and Machine Cognition, Florida, 2008.
4. M.L.M. Hu and M.H. Wu, "The effect of concept mapping on students' cognitive load, " World Transactions on Engineering and Technology Education, vol.10, no.2, pp.134-137, 2012.
5. J.D. Novak and D.B. Gowin, Learning how to learn, Cambridge University Press, New York, 1984.
6. J.R. McClure and P.E. Bell, Effects of an environmental education related STS approach instruction on cognitive structures of preservice science teachers, State University, Pennsylvania, 1990.
7. T. Hirashima, K. Yamasaki, H. Fukuda, and H. Funaoi, "Kit-Build concept map for automatic diagnosis, " Proc. 15th of Artificial Intelligence in Education 2011, Auckland, New Zealand, pp.466-468, 2011.
8. T. Hirashima, K. Yamasaki, H. Fukuda, and H. Funaoi, "Framework of Kit-Build concept map for automatic diagnosis and its preliminary use, " Research and Practice in Technology Enhanced Learning, vol.10, no.1, pp.1-21, 2015.
9. K. Sugihara, T. Osada, S. Nakata, H. Funaoi, and T. Hirashima, "Experimental evaluation of Kit-Build concept map for science classes in an elementary school, " Proc. Int. Conf. on Computers in Education 2012, Singapore, pp.17-24, 2012.
10. K. Yoshida, K. Sugihara, Y. Nino, M. Shida, and T. Hirashima, "Practical use of Kit-Build concept map system for formative assessment of learners' comprehension in a lecture, " Proc. Int. Conf. on Computers in Education 2013, Bali, Indonesia, pp.906-915, 2013.
11. T. Nomura, Y. Hayashi, Y., T. Suzuki, T. and T. Hirashima, "Knowledge propagation in practical use of Kit-Build concept map system in classroom group work for knowledge sharing, " Proc. Int. Conf. on Computers in Education Workshop 2014, Nara, Japan, pp.463-472, 2014.
12. Y. Hayashi and T. Hirashima, "Kit-Build Concept Mapping for Being Aware of the Gap of Exchanged Information in Collaborative Reading of the Literature, " Proc. Int. Conf. on Human Interface and the Management of Information, Greece, pp.31-41, 2014.
13. Y. Hayashi and T. Hirashima, "Analysis of the Relationship Between Metacognitive Ability and Learning Activity with Kit-Build Concept Map, " Proc. Int. Conf. on Human Interface and the Management of Information, United States, pp.304-312, 2015.
14. M. Alkhateeb, Y. Hayashi, T. Rajab, and T. Hirashima, "Comparison between Kit-Build and Scratch-Build concept mapping methods in supporting EFL reading comprehension, " The Journal of Information and Systems in Education, vol.14, no.1, pp.13-27, 2015.
15. M. Alkhateeb, Y. Hayashi, and T. Hirashima, "The effects of using Kit-Build method to Support Reading Comprehension of EFL, " Proc. Int. Conf. on Human Interface and the Management of Information, Greece, pp.3-11, 2014.
16. Y. Hayashi, M. Ui, M. Kayashima, and T. Hirashima, "An Experimental Use of Kit-Build Concept Map with Approval Link in a Lecture of the Humanities, " Japan Journal of Educational Technology, vol.38, pp.149-152, 2016.
17. T. Kitamura, A. Yamanaka, K. Maeda, Y. Hayashi, and T. Hirashima, "Learning Task Generation from a Series of Propositions of a Learning Topic: Kit-Building Task of Concept Map and Multiple Choice Task of Fill-in-The-blank Questions, " Proc. 24th Int. Conf. on Computers in Education, India, pp.91-93, 2016.
18. M. Alkhateeb, Y. Hayashi, T. Rajab, and T. Hirashima, "Experimental Use of Kit-Build Concept Map System to Support Reading Comprehension of EFL in Comparing with Selective Underlining Strategy, " International Journal of Advanced Computer Science and Applications, vol.7, no.4, pp.80-87, 2016.
19. H. Funoi, K. Ishida, and T. Hirashima, "Comparison of kit-build and scratch-build concept mapping methods on memory retention, " Proc. 19th Int. Conf. on Computers in Education, Thailand, pp.539- 546, 2011.
20. J.R. McClure, B. Sonak, and H.K. Suen, "Concept map assessment of classroom learning: reliability, validity, and logistical practicality, " Journal of Research in Science Teaching, vol.36, no.4, pp.475-492, 1999.
21. W. Wunnasri, J. Pailai, Y. Hayashi, and T. Hirashima, "Reliability investigation of automatic assessment of learner-build concept map with Kit-Build method by comparing with manual methods, " Proc. 18th Int. Conf. on Artificial Intelligence in Education, Hubei, China, pp.418-429, 2017.
22. M.A. Ruiz-Primo, S.E. Schultz, M. Li, and R.J. Shavelson, "Comparison of the reliability and validity of scores from two conceptmapping techniques, " Journal of Research in Science Teaching, vol.38, no.2, pp.260-278, 2011.
23. M.A. Ruiz-Primo, "Examining concept maps as an assessment tool, " Proc. 1st Int. Conf. on Concept Mapping, Pamplona, Spain, pp.555- 563, 2004.
24. J. Pailai, W. Wunnasri, K. Yoshida, Y. Hayashi, and T. Hirashima, "The practical use of Kit-Build concept map on formative assessment, " Research and Practice in Technology Enhanced Learning, vol.20, no.12, pp.1-23, 2017.
25. B.E. Cline, C.C. Brewster, and R.D. Fell, "A rule-based system for automatically evaluating student concept maps, " Expert systems with applications, vol.37, no.3, pp.2282-2291, 2010.
26. D.B. Luckie, S.H. Harrison, and D. Ebert-May, "Introduction to CTools: concept mapping tools for online learning, " Proc. 1st Int. Conf. on Concept Mapping, Pamplona, Spain, pp.261-264, 2004.
27. S.H. Harrison, J.L. Wallace, D. Ebert-May, and D.B. Luckie, "CTOOLS automated grading for online concept maps works well with a little help from WordNet in concept maps: Theory, methodology, technology, " Proc. 1st Int. Conf. on Concept Mapping, Pamplona, Spain, pp.211-214, 2004.
28. H. Kornilakis, M. Grigoriadou, K.A. Papanikolaou, and E. Gouli, "Using WordNet to support interactive concept map construction, " Proc. 4th IEEE Int. Conf. on Advanced Learning Technologies, Joensuu, Finland, pp.600-604, 2004.
29. R. Klaus, "Sugar, " http://www.english-online.at/biology/sugar/sugar-carbohydrate-That-gives-us-energy.htm, accessed March 27, 2017.
30. The Institute for Human & Machine Cognition, "Cmap Cloud & CmapTools in the cloud, " http://cmap.ihmc.us/cmap-cloudaccessed March 11, 2017.
31. R.L. Brennan, Elements of generalizability theory, American College Testing Program, Arizona, 1983.
32. N.M. Webb and R.J. Shavelson, Generalizability theory: overview, Encyclopedia of Statistics in Behavioral Science, Wiley, Chichester, 2005.
33. S. Messick, "The once and future issues of validity: Assessing the meaning and consequences of measurement, " ETS Research Report Series, vol.1986, no.2, 1986.
34. J.D. Evans, Straightforward statistics for the behavioral sciences, Brooks/Cole, California, 1996.