Toward automated computer-based visualization and assessment of team-based performance

Journal of Educational Psychology

Volumn 106, Issue 3, 2014, Pages 651-665

  Ifenthaler, Dirk ^a  

^a DEAKIN UNIVERSITY   (Australia)

Author keywords

Automated assessment; Natural language processing; Shared mental model; Team

Indexed keywords

EID: 84894278804     PISSN: 00220663     EISSN: 19392176     Source Type: Journal    
DOI: 10.1037/a0035505     Document Type: Article

References (115)

1. Akkerman, S., Van den Bossche, P., Admiraal, W., Gijselaers, W., Segers, M., Simons, R., & Kirschner, P. A. (2007). Reconsidering group cognition: From conceptual confusion to a boundary area between cognitive and socio-cultural perspectives? Educational Research Review, 2, 39-63. doi:10.1016/j.edurev.2007.02.001
2. Al-Diban, S., & Ifenthaler, D. (2011). Comparison of two analysis approaches for measuring externalized mental models: Implications for diagnostics and applications. Journal of Educational Technology & Society, 14, 16-30.
3. Almond, R. G., Steinberg, L. S., & Mislevy, R. J. (2002). Enhancing the design and delivery of assessment systems: A four process architecture. Journal of Technology, Learning, and Assessment, 1, 3-63.
4. Amthauer, R., Brocke, B., Liepmann, D., & Beauducel, A. (2001). I-S-T 2000 R. Göttingen, Germany: Hogrefe.
5. Badke-Schaub, P., Neumann, A., & Lauche, K. (2011). An observationbased method for measuring the sharedness of mental models in teams. In M. Boos, M. O. Kolbe, P. M. Kappeler, & T. Ellwart (Eds.), Coordination in human and primate groups (pp. 177-197). Berlin, Germany: Springer. doi:10.1007/978-3-642-15355-6_10
6. Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191-215. doi:10.1037/0033-295X.84.2.191
7. Bandura, A. (1986). Social foundation of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
8. Barron, B. (2000). Achieving coordination in collaborative problemsolving groups. Journal of the Learning Sciences, 9, 403-436. doi: 10.1207/S15327809JLS0904_2
9. Bartelt, V. L., Dennis, A. R., Yuan, L., & Barlow, J. B. (2013). Individual priming in virtual team decision-making. Group Decision and Negotiation, 22, 873-896. doi:10.1007/s10726-012-9333-3
10. Beer, M., Slack, F., & Armitt, G. (2005). Collaboration and teamwork: Immersion and presence in an online learning environment. Information Systems Frontiers, 7, 27-37. doi:10.1007/s10796-005-5336-9
11. Bierhals, R., Schuster, I., Kohler, P., & Badke-Schaub, P. (2007). Shared mental models-Linking team cognition and performance. CoDesign, 3, 75-94. doi:10.1080/15710880601170891
12. Brill, E. (1995). Unsupervised learning of disambiguation rules for part of speech tagging. Paper presented at the Second Workshop on Very Large Corpora, WVLC-95, Boston, MA.
13. Burke, C. S., Fiore, S. M., & Salas, E. (2003). The role of shared cognition in enabling shared leadership and team adaptability. In C. L. Pearce & J. A. Conger (Eds.), Shared leadership: Reframing the hows and whys of leadership (pp. 103-122). Thousand Oaks, CA: Sage. doi:10.4135/ 9781452229539.n5
14. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasiexperimental designs for research. Boston, MA: Houghton Mifflin.
15. Cannon-Bowers, J. A., & Salas, E. (2001). Reflections on shared cognition. Journal of Organizational Behavior, 22, 195-202. doi:10.1002/job.82
16. Cannon-Bowers, J. A., Salas, E., & Converse, S. (1993). Shared mental models in expert team decision making. In J. Castellan (Ed.), Individual and group decision making: Current issues (pp. 221-246). Mahwah, NJ: Erlbaum.
17. Carley, K. M. (1997). Extracting team mental models through textual analysis. Journal of Organizational Behavior, 18, 533-558. doi:10.1002/(SICI)1099-1379(199711)18:1+533::AID-JOB9063.3.CO;2-V
18. Chambers, B., & Abrami, P. C. (1991). The relationship between student team learning outcomes and achievement, causal attributions, and affect. Journal of Educational Psychology, 83, 140-146. doi:10.1037/0022-0663.83.1.140
19. Cheng, K.-H., & Tsai, C.-C. (2013). Affordances of augmented reality in science learning: Suggestions for future research. Journal of Science Education and Technology, 22, 449-462. doi:10.1007/s10956-012-9405-9
20. Chomsky, N. (1970). Sprache und Geist. Frankfurt am Main, Germany: Suhrkamp.
21. Chung, G. K. W., O'Neil, H. F., & Herl, H. E. (1999). The use of computer-based collaborative knowledge mapping to measure team processes and team outcomes. Computers in Human Behavior, 15, 463-493. doi:10.1016/S0747-5632(99)00032-1
22. Clariana, R. B. (2010). Deriving individual and group knowledge structure from network diagrams and from essays. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge (pp. 117-130). New York, NY: Springer. doi:10.1007/978-1-4419-5662-0_7
23. Cohen, P. R., Levesque, H. J., & Smith, I. A. (1997). On team formation. In G. Holmström-Hintikka & R. Tuomela (Eds.), Contemporary action theory: Social action (Vol. 2, pp. 87-114). Amsterdam, the Netherlands: Springer.
24. Cooke, N. J., Salas, E., Cannon-Bowers, J. A., & Stout, R. J. (2000). Measuring team knowledge. Human Factors: The Journal of the Human Factors and Ergonomics Society, 42, 151-173. doi:10.1518/ 001872000779656561
25. Cooke, N. J., Salas, E., Kiekel, P. A., & Bell, B. (2004). Advances in measuring team cognition. In E. Salas & S. M. Fiore (Eds.), Team cognition: Understanding the factors that drive process and performance (pp. 83-106). Washington, DC: American Psychological Association. doi:10.1037/10690-005
26. Coronges, K. A., Stacy, A. W., & Valente, T. W. (2007). Structural comparison of cognitive associative networks in two populations. Journal of Applied Social Psychology, 37, 2097-2129. doi:10.1111/j.1559-1816.2007.00253.x
27. Cox, T., & Blake, S. (1991). Managing cultural diversity: Implications for organizational competitiveness. Academy of Management Executive, 5, 45-56.
28. Csapó, B., Ainley, J., Bennett, R. E., Latour, T., & Law, N. (2012). Technological issues for computer-based assessment. In P. Griffin, B. McGaw, & E. Care (Eds.), Assessment and teaching of 21st century skills (pp. 143-230). Amsterdam, the Netherlands: Springer. doi: 10.1007/978-94-007-2324-5_4
29. Ding, Y. (2001). A review of ontologies with the semantic web in view. Journal of Information Science, 27, 377-384. doi:10.1177/ 016555150102700603
30. Eccles, D. W., & Tenenbaum, G. (2004). Why an expert team is more than a team of experts: A social-cognitive conceptualization of team coordination and communication in sport. Journal of Sport & Exercise Psychology, 26, 542-560.
31. Ellson, J., Gansner, E. R., Koutsofios, E., North, S. C., & Woodhull, G. (2003). GraphViz and Dynagraph. Static and dynamic graph drawing tools. Florham Park, NJ: AT & T Labs.
32. Fischer, F., Bruhn, J., Gräsel, C., & Mandl, H. (2002). Fostering collaborative knowledge construction with visualization tools. Learning and Instruction, 12, 213-232. doi:10.1016/S0959-4752(01)00005-6
33. Fischer, F., & Mandl, H. (2005). Knowledge convergence in computersupported collaborative learning: The role of external representation tools. Journal of the Learning Sciences, 14, 405-441. doi:10.1207/ s15327809jls1403_3
34. Foltz, P. W., Kintsch, W., & Landauer, T. K. (1998). The measurement of textual coherence with latent semantic analysis. Discourse Processes, 25, 285-307. doi:10.1080/01638539809545029
35. Frazier, L. (1999). On sentence interpretation. Dordrecht, the Netherlands: Kluwer. doi:10.1007/978-94-011-4599-2
36. Frey, A., & Hartig, J. (2013). Wann sollten computerbasierte Verfahren zur Messung von Kompetenzen anstelle von papier-und bleistift-basierten Verfahren eingesetzt werden? [In which settings should computer-based tests be used instead of paper and pencil-based tests?] Zeitschrift für Erziehungswissenschaft, 16, 53-57. doi:10.1007/s11618-013-0385-1
37. Gentner, D., & Stevens, A. L. (1983). Mental models. Hillsdale, NJ: Erlbaum.
38. Goldsmith, T. E., & Davenport, D. M. (1990). Assessing structural similarity of graphs. In R. W. Schvaneveldt (Ed.), Pathfinder associative networks: Studies in knowledge organization (pp. 75-87). Norwood, NJ: Ablex.
39. Greiff, S., Wüstenberg, S., Holt, D. V., Goldhammer, F., & Funke, J. (2013). Computer-based assessment of complex problem solving: Concept, implementation, and application. Educational Technology Research and Development, 61, 407-421. doi:10.1007/s11423-013-9301-x
40. Greiff, S., Wüstenberg, S., Molnár, G., Fischer, A., Funke, J., & Csapó, B. (2013). Complex problem solving in educational contexts -Something beyond g: Concept, assessment, measurement invariance, and construct validity. Journal of Educational Psychology, 105, 364 -379. doi: 10.1037/a0031856
41. Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Educational Technology & Society, 15, 42-57.
42. Guzzo, R. A., & Dickson, M. W. (1996). Teams in organizations: Recent research on performance and effectiveness. Annual Review of Psychology, 47, 307-338. doi:10.1146/annurev.psych.47.1.307
43. Gweon, G., Rosé, C. P., Wittwer, J., & Nueckles, M. (2005). Supporting efficient and reliable content analysis using automatic text processing technology. In M. F. Costabile & F. Paternò (Eds.), Human-computer interaction -INTERACT 2005 (Vol. 3585, pp. 1112-1115). Berlin, Germany: Springer. doi:10.1007/11555261_117
44. Hambrick, D. C., Cho, T. S., & Chen, M. J. (1996). The influence of top management team heterogeneity on firms' competitive moves. Administrative Science Quarterly, 41, 659-684. doi:10.2307/2393871
45. Helbig, H. (2006). Knowledge representation and the semantics of natural language. Berlin, Germany: Springer.
46. Herl, H. E., O'Neil, H. F., Chung, G. K. W. K., & Schacter, J. (1999). Reliability and validity of a computer-based knowledge mapping system to measure content understanding. Computers in Human Behavior, 15, 315-333. doi:10.1016/S0747-5632(99)00026-6
47. Horwitz, S. K. (2005). The compositional impact of team diversity on performance: Theoretical considerations. Human Resource Development Review, 4, 219-245. doi:10.1177/1534484305275847
48. Horwitz, S. K., & Horwitz, I. B. (2007). The effects of team diversity on team outcomes: A meta-analytic review of team demography. Journal of Management, 33, 987-1015. doi:10.1177/0149206307308587
49. Ifenthaler, D. (2009). Model-based feedback for improving expertise and expert performance. Technology, Instruction, Cognition and Learning, 7, 83-101.
50. Ifenthaler, D. (2010). Bridging the gap between expert-novice differences: The model-based feedback approach. Journal of Research on Technology in Education, 43, 103-117.
51. Ifenthaler, D. (2010). Relational, structural, and semantic analysis of graphical representations and concept maps. Educational Technology Research and Development, 58, 81-97. doi:10.1007/s11423-008-9087-4
52. Ifenthaler, D. (2010). Scope of graphical indices in educational diagnostics. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge (pp. 213-234). New York, NY: Springer. doi:10.1007/978-1-4419-5662-0_12
53. Ifenthaler, D. (2011). Identifying cross-domain distinguishing features of cognitive structures. Educational Technology Research and Development, 59, 817-840. doi:10.1007/s11423-011-9207-4
54. Ifenthaler, D. (2012). Determining the effectiveness of prompts for selfregulated learning in problem-solving scenarios. Journal of Educational Technology & Society, 15, 38-52.
55. Ifenthaler, D., & Eseryel, D. (2013). Facilitating complex learning by mobile augmented reality learning environments. In R. Huang, Kinshuk, & J. M. Spector (Eds.), Reshaping learning: The frontiers of learning technologies in a global context (pp. 415-438). New York, NY: Springer.
56. Ifenthaler, D., & Lehmann, T. (2012). Preactional self-regulation as a tool for successful problem solving and learning. Technology, Instruction, Cognition and Learning, 9, 97-110.
57. Ifenthaler, D., Masduki, I., & Seel, N. M. (2011). The mystery of cognitive structure and how we can detect it: Tracking the development of cognitive structures over time. Instructional Science, 39, 41-61. doi: 10.1007/s11251-009-9097-6
58. Ifenthaler, D., & Pirnay-Dummer, P. (2014). Model-based tools for knowledge assessment. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (4th ed., pp. 289-301). New York, NY: Springer.
59. Ifenthaler, D., & Seel, N. M. (2013). Model-based reasoning. Computers and Education, 64, 131-142. doi:10.1016/j.compedu.2012.11.014
60. Janssen, J., Erkens, G., Kirschner, P. A., & Kanselaar, G. (2010). Effects of representational guidance during computer-supported collaborative learning. Learning and Instruction, 38, 59-88. doi:10.1007/s11251-008-9078-1
61. Johnson, T. E., Ifenthaler, D., Pirnay-Dummer, P., & Spector, J. M. (2009). Using concept maps to assess individuals and teams in collaborative learning environments. In P. L. Torres & R. C. V. Marriott (Eds.), Handbook of research on collaborative learning using concept mapping (pp. 358-381). Hershey, PA: Information Science Publishing. doi: 10.4018/978-1-59904-992-2.ch018
62. Johnson, T. E., & Lee, Y. (2008). The relationship between shared mental models and task performance in an online team-based learning environment. Performance Improvement Quarterly, 21, 97-112. doi:10.1002/piq.20033
63. Johnson, T. E., Lee, Y., Lee, M., & O'Connor, D. L. (2007). Measuring sharedness of team-related knowledge: Design and validation of a shared mental model instrument. Human Resource Development International, 10, 437-454. doi:10.1080/13678860701723802
64. Johnson, T. E., Pirnay-Dummer, P., Ifenthaler, D., Mendenhall, A., Karaman, S., & Tennenbaum, G. (2011). Text summaries or concept maps: Which better represent reading text conceptualization? Technology, Instruction, Cognition and Learning, 8, 297-312.
65. Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference, and consciousness. Cambridge, United Kingdom: Cambridge University Press.
66. Johnson-Laird, P. N. (1989). Mental models. In M. I. Posner (Ed.), Foundations of cognitive science (pp. 469-499). Cambridge, MA: MIT Press.
67. Jonassen, D. H., Beissner, K., & Yacci, M. (1993). Structural knowledge: Techniques for representing, conveying, and acquiring structural knowledge. Hillsdale, NJ: Erlbaum.
68. Jonassen, D. H., & Cho, Y. H. (2008). Externalizing mental models with mindtools. In D. Ifenthaler, P. Pirnay-Dummer, & J. M. Spector (Eds.), Understanding models for learning and instruction: Essays in honor of Norbert M. Seel (pp. 145-159). New York, NY: Springer. doi:10.1007/ 978-0-387-76898-4_7
69. Kanaga, K., & Kossler, M. E. (2011). How to form a team: Five keys to high performance. Greensboro, NC: Center for Creative Leadership.
70. Kant, I. (1998). Kritik der reinen Vernunft [Critique of pure reason]. Hamburg, Germany: Meiner Verlag. (Original work published 1781)
71. Katzenbach, J. R., & Smith, D. K. (1993). The discipline of teams. Harvard Business Review, 71, 111-120.
72. Katzenbach, J. R., & Smith, D. K. (2003). The wisdom of teams: Creating the high-performance organization. New York, NY: Collins Business.
73. Kim, M. K. (2012). Cross-validation study of methods and technologies to assess mental models in a complex problem solving situation. Computers in Human Behavior, 28, 703-717. doi:10.1016/j.chb.2011.11.018
74. Klimoski, R., & Mohammed, S. (1994). Team mental model: Construct or metaphor? Journal of Management, 20, 403-437. doi:10.1016/0149-2063(94)90021-3
75. Kozlowski, S. W. J., & Ilgen, D. R. (2006). Enhancing the effectiveness of work groups and teams. Psychological Science in the Public Interest, 7, 77-124.
76. Lenz, R., & Machado, C. (2008). Virtual teamwork: A product of globalization. In N. P. Barsky, M. Clements, J. Ravn, & K. Smith (Eds.), The power of technology for learning (pp. 77-93). Amsterdam, the Netherlands: Springer. doi:10.1007/978-1-4020-8747-9_5
77. Lim, B.-C., & Klein, K. J. (2006). Team mental models and team performance: A field study of the effects of team mental model similarity and accuracy. Journal of Organizational Behavior, 27, 403-418. doi: 10.1002/job.387
78. Long, P. D., & Siemens, G. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE Review, 46, 31-40.
79. Macfadyen, L., & Dawson, S. (2012). Numbers are not enough. Why e-Learning analytics failed to inform an institutional strategic plan. Educational Technology & Society, 15, 149-163.
80. Mandl, H., & Fischer, F. (2000). Mapping-Techniken und Begriffsnetze in Lern-und Kooperationsprozessen [Mapping techniques and concept maps in learning and cooperating processes]. In H. Mandl & F. Fischer (Eds.), Wissen sichtbar machen -Wissensmanagement mit Mapping-Techniken [Making knowledge visible: Knowledge management with mapping techniques] (pp. 3-12). Göttingen, Germany: Hogrefe.
81. Markman, A. B. (1999). Knowledge representation. Mahwah, NJ: Erlbaum. Marks, M. A., Zaccaro, S. J., & Mathieu, J. E. (2000). Performance implications of leader briefings and team-interaction training for team adaptation to novel environments. Journal of Applied Psychology, 85, 971-986. doi:10.1037/0021-9010.85.6.971
82. Mathieu, J. E., Heffner, T. S., Goodwin, G. F., Cannon-Bowers, J. A., & Salas, E. (2005). Scaling the quality of teammates' mental models: Equifinality and normative comparisons. Journal of Organizational Behavior, 26, 37-56. doi:10.1002/job.296
83. Mathieu, J. E., Heffner, T. S., Goodwin, G. F., Salas, E., & Cannon-Bowers, J. A. (2000). The influence of shared mental models on team process and performance. Journal of Applied Psychology, 85, 273-283. doi:10.1037/0021-9010.85.2.273
84. McKeown, J. O. (2009). Using annotated concept map assessments as predictors of performance and understanding of complex problems for teacher technology integration. Tallahassee: Florida State University.
85. Mesmer-Magnus, J. R., & Dechurch, L. A. (2009). Information sharing and team performance: A meta-analysis. Journal of Applied Psychology, 94, 535-546. doi:10.1037/a0013773
86. Minsky, M. (1981). A framework for representing knowledge in mind design. In R. J. Brachmann & H. J. Levesque (Eds.), Readings in knowledge representation (pp. 245-262). Los Altos, CA: Morgan Kaufmann.
87. Mislevy, R. J., Behrens, J. T., Bennett, R. E., Demark, S. F., Frezzo, D. C., Levy, R., . . . Winters, F. I. (2010). On the roles of external knowledge representations in assessment design. Journal of Technology, Learning, and Assessment, 8, 4-55.
88. Miyake, N. (1986). Constructive interaction and the iterative process of understanding. Cognitive Science, 10, 151-177. doi:10.1207/ s15516709cog1002_2
89. Mohammed, S., & Dumville, B. C. (2001). Team mental models in a team knowledge framework: Expanding theory and measurement across disciplinary boundaries. Journal of Organizational Behavior, 22, 89-106. doi:10.1002/job.86
90. Mohammed, S., Klimoski, R., & Rentsch, J. R. (2000). The measurement of team mental models: We have no shared schema. Organizational Research Methods, 3, 123-165. doi:10.1177/109442810032001
91. Moreland, R. L., & Levine, J. M. (1992). The composition of small groups. In E. Lawler, B. Markovsky, C. Ridgeway, & H. Walker (Eds.), Advances in group processes (pp. 237-280). Greenwich, CT: JAI Press.
92. O'Neil, H. F., Chuang, S.-H., & Baker, E. L. (2010). Computer-based feedback for computer-based collaborative problem solving. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge (pp. 261-280). New York, NY: Springer. doi:10.1007/978-1-4419-5662-0_14
93. Organisation for Economic Co-Operation and Development. (2010). PISA computer-based assessment of student skills in science. Paris, France: Author.
94. Organisation for Economic Co-Operation and Development. (2013). PISA 2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy. Paris, France: Author.
95. Pirnay-Dummer, P., & Ifenthaler, D. (2010). Automated knowledge visualization and assessment. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge (pp. 77-115). New York, NY: Springer. doi:10.1007/978-1-4419-5662-0_6
96. Pirnay-Dummer, P., & Ifenthaler, D. (2011). Reading guided by automated graphical representations: How model-based text visualizations facilitate learning in reading comprehension tasks. Instructional Science, 39, 901-919. doi:10.1007/s11251-010-9153-2
97. Pirnay-Dummer, P., Ifenthaler, D., & Spector, J. M. (2010). Highly integrated model assessment technology and tools. Educational Technology Research and Development, 58, 3-18. doi:10.1007/s11423-009-9119-8
98. Pollio, H. R. (1966). The structural basis of word association behavior. The Hague, the Netherlands: Mouton.
99. Ruiz-Primo, M. A., Schultz, S. E., Li, M., & Shavelson, R. J. (2001). Comparison of the reliability and validity of scores from two concept-mapping techniques. Journal of Research in Science Teaching, 38, 260 -278. doi:10.1002/1098-2736(200102)38:2260::AIDTEA10053.0.CO;2-F
100. Rumelhart, D. E., & Norman, D. A. (1978). Accretion, tuning and restructuring: Three models of learning. In R. L. Klatzky & J. W. Cotton (Eds.), Semantic factors in cognition (pp. 37-53). Hillsdale, NJ: Erlbaum.
101. Salas, E., Cooke, N. J., & Rosen, M. A. (2008). On teams, teamwork, and team performance: Discoveries and developments. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50, 540-547. doi:10.1518/001872008X288457
102. Salas, E., Dickinson, T. L., Converse, S. A., & Tannenbaum, S. I. (1992). Toward an understanding of team performance and training. In R. W. Swezey & E. Salas (Eds.), Teams: Their training and performance (pp. 3-29). Westport, CT: Ablex.
103. Savenye, W. C. (2014). Perspectives on assessment of educational technologies for informal learning. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (pp. 257-267). New York, NY: Springer. doi:10.1007/978-1-4614-3185-5_21
104. Schvaneveldt, R. W. (Ed.). (1990). Pathfinder associative networks: Studies in knowledge organization. Norwood, NJ: Ablex.
105. Searle, J., & Grewendorf, G. (2002). Speech acts, mind, and social reality. Dordrecht, the Netherlands: Kluwer Academic Publishers.
106. Seel, N. M. (1999). Educational diagnosis of mental models: Assessment problems and technology-based solutions. Journal of Structural Learning and Intelligent Systems, 14, 153-185.
107. Sikorski, E. G., Johnson, T. E., & Ruscher, P. H. (2012). Team knowledge sharing intervention effects on team shared mental models and student performance in an undergraduate science course. Journal of Science Education and Technology, 21, 641-651. doi:10.1007/s10956-011-9353-9
108. Spector, J. M., & Koszalka, T. A. (2004). The DEEP methodology for assessing learning in complex domains (Final report to the National Science Foundation Evaluative Research and Evaluation Capacity Building). Syracuse, NY: Syracuse University.
109. Strasser, A. (2010). A functional view toward mental representations. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge (pp. 15-25). New York, NY: Springer. doi:10.1007/978-1-4419-5662-0_2
110. Taricani, E. M., & Clariana, R. B. (2006). A technique for automatically scoring open-ended concept maps. Educational Technology Research and Development, 54, 65-82. doi:10.1007/s11423-006-6497-z
111. Tittmann, P. (2010). Graphs and networks. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge (pp. 177-188). New York, NY: Springer. doi:10.1007/978-1-4419-5662-0_10
112. Tversky, A. (1977). Features of similarity. Psychological Review, 84, 327-352. doi:10.1037/0033-295X.84.4.327
113. Van den Bossche, P., Gijselaers, W., Segers, M., Woltjer, G., & Kirschner, P. A. (2011). Team learning: Building shared mental models. Instructional Science, 39, 283-301. doi:10.1007/s11251-010-9128-3
114. Wildman, J. L., Thayer, A. L., Pavlas, D., Salas, E., Stewart, J. E., & Howse, a. W. R. (2012). Team knowledge research: Emerging trends and critical needs. Human Factors: The Journal of the Human Factors and Ergonomics Society, 54, 84-111. doi:10.1177/0018720811425365
115. Wittgenstein, L. (1922). Tractatus logico-philosophicus. New York, NY: Harcourt Brace & Company.