Measuring Cognitive Engagement With Self-Report Scales: Reflections From Over 20 Years of Research

Educational Psychologist

Volumn 50, Issue 1, 2015, Pages 14-30

  Greene, Barbara A ^a  

^a UNIVERSITY OF OKLAHOMA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84924238788     PISSN: 00461520     EISSN: None     Source Type: Journal    
DOI: 10.1080/00461520.2014.989230     Document Type: Article

References (104)

1. Alexander, P. A., & Judy, J. E. (1988). The interaction of domain-specific and strategic knowledge in academic performance. Review of Educational Research, 58, 375–404.
2. Anderman, E. M., & Young, A. J. (1994). Motivation and strategy use in science: Individual differences and classroom effects. Journal of Research in Science Teaching, 31, 811–831.
3. Anderson, J. R. (1996). ACT: A simple theory of complex cognition. American Psychologist, 51, 355–365. http://dx.doi.org/10.1037/0003-066X.51.4.355
4. Anderson, J. R., & Reder, L. M. (1979). An elaborative processing explanation of depth of processing. In L. S. Cermak & F. I. M. Craik (Eds.), Levels of processing in human memory (pp. 385–395). Hillsdale, NJ: Erlbaum.
5. Azevedo, R., Moos, D. C., Johnson, A. M., & Chauncey, A. D. (2010). Measuring cognitive and metacognitive regulatory processes during hypermedia learning: Issues and challenges. Educational Psychologist, 45, 210–223. http://dx.doi.org/10.1080/00461520.2010.515934
6. Bandura, A. (2001). Social cognitive theory: An agentive perspective. Annual Review of Psychology, 52, 1–26.
7. Biggs, J. (1993). What do inventories of students' learning processes really measure? A theoretical review and clarification. British Journal of Educational Psychology, 63(1), 3–19.
8. Bryan, R. R., Glynn, S. M., & Kittleson, J. M. (2011). Motivation, achievement, and advanced placement intent of high school students learning science. Science Education, 95, 1049–1065. doi:10.1002/sce.20462
9. Chan, D. (2009). So why ask me? Are self-report data really that bad? In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 309–336). New York, NY: Routledge/Taylor & Francis.
10. Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981). Categorization and representation of physics problems by expert and novices. Cognitive Science, 5, 121–152. http://dx.doi.org/10.1207/s15516709cog0502_2
11. Chi, M. T. H., Glaser, R, & Farr, P. J. (1993). The nature of expertise. Hillsdale, NJ: Erlbaum.
12. Chin, C. (2007). Teacher questioning in science classrooms: Approaches that stimulate productive thinking. Journal of Research in Science Teaching, 44(6), 8–15.
13. Cleary, T. J., & Zimmerman, B. J. (2012). A cyclical self-regulatory account of student engagement: Theoretical foundations and applications. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 237–257). New York, NY: Springer.
14. Craik, F. I. M., & Lockhart, R. S. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11, 671–684. http://dx.doi.org/10.1016/S0022-5371(72)80001-X
15. Dinsmore, D. L., & Alexander, P. A. (2012). A critical discussion of deep and surface processing: What it means, how it is measured, the role of context, and model specification. Educational Psychology Review, 24, 499–567. http://dx.doi.org/10.1007/s10648-012-9198-7
16. Dweck, C. S. (1986). Motivational processes affecting learning. American Psychologist, 41, 1040–1048.
17. Dweck, C. S., & Leggett, E. L. (1988). A social-cognitive approach to motivation and personality. Psychological Review, 95, 256–273.
18. Elliot, A. J. (1999). Approach and avoidance motivation and achievement goals. Educational Psychologist, 34, 169–189.
19. Elliot, A. J., & McGregor, H. A. (2001). A 2 ´ 2 achievement goal framework. Journal of Personality and Social Psychology, 80, 501–519.
20. Entwistle, N. J., & Entwistle, D. M. (1970). The relationships between personality, study methods and academic performance. British Journal of Educational Psychology, 40, 132–141. http://dx.doi.org/10.1111/j.2044-8279.1970.tb02113.x
21. Entwistle, N., & McCune, V. (2004). The conceptual bases of study strategy inventories. Educational Psychology Review, 16, 325–345. http://dx.doi.org/10.1007/s10648-004-0003-0
22. Entwistle, N. J., & Ramsden, P. (1982). Understanding student learning. London, England: Croom Helm.
23. Epstein, S., Pacini, R., Denes-Raj, V., & Heier, H. (1996). Individual differences in intuitive-experiential and analytical-rational thinking styles. Journal of Personality and Social Psychology, 71, 390–405.
24. Ericsson, K., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215–51.
25. Eysenck, M. W., & Eysenck, M.C. (1979). Processing depth, elaboration of encoding, memory stores, and expended processing capacity. Journal of Experimental Psychology: Human Learning And Memory, 5, 472–484. http://dx.doi.org/10.1037/0278-7393.5.5.472
26. Fredricks, J. A., Blumenfeld, P., & Paris, A. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74, 59–109. http://dx.doi.org/10.3102/00346543074001059
27. Fredricks, J. A., & McColskey, W. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 763–782). New York, NY: Springer.
28. Ge, X., Thomas, M. K., & Greene, B. A. (2006). Technology-rich ethnography for examining the transition to authentic problem solving in a high school computer programming class. Journal of Educational Computing Research, 34, 319–352.
29. Glynn, S. M., Brickman, P., Armstrong, N., & Taasoobshirazi, G. (2011). Science Motivation Questionnaire II: Validation with science majors and nonscience majors. Journal of Research in Science Teaching, 48, 1159–1176. http://dx.doi.org/10.1002/tea.20442.
30. Glynn, S. M., Taasoobshirazi, G., & Brickman, P. (2009). Science Motivation Questionnaire: Construct validation with nonscience majors. Journal of Research in Science Teaching, 46, 127–146. http://dx.doi.org/10.1002/tea.20267
31. Gobert, J. D., Baker, R. S., & Wixon, M. B. (this issue). Operationalizing and detecting disengagement within online science microworlds. Educational Psychologist, 50.
32. Graham, S., & Golan, S. (1991). Motivational influences on cognition: Task involvement, ego involvement and depth of processing. Journal of Educational Psychology, 83, 187–194. http://dx.doi.org/10.1037/0022-0663.83.2.187
33. Greene, B. A. (2010). Teacher quality and student success: Testing the K20 Science Professional Development Model (K20 Science) for Rural Science Teachers (NSF Final Report, Award No. 0634070).
34. Greene, B. A., DeBacker, T. K., Ravindran, B., & Krows, A. J. (1999). Goals, values, and beliefs as predictors of achievement and effort in high school mathematics classes. Sex Roles, 40, 421–458.
35. Greene, B. A., Dillon, C., & Crynes, B. (2003). Distributive learning in introductory chemical engineering: Two studies of university students’ learning, motivation, and attitudes using a CD-ROM. Journal of Educational Computing Research, 29, 189–207.
36. Greene, B. A., Dillon, C., Miller, R. B., Davis, K. A., & Mason, B. A. (2007, April). College student achievement in physics: Is it really all about the formulas? Paper presented at the annual meeting of the American Educational Research Association, Chicago, IL.
37. Greene, B. A., Dillon, C., Miller, R. B., Davis, K. A., Nelson, D., & Brammer, C. (2007, April). Changes in motivation and cognitive engagement across a semester: When the going gets tough, the tough get going. Poster presented at the annual meeting of the American Educational Research Association, Chicago, IL.
38. Greene, B. A., & Miller, R. B. (1993, April). Influences on course performance: Goals, perceived ability, and self-regulation. Poster presented at the annual meeting of the American Educational Research Association, Atlanta, GA.
39. Greene, B. A., & Miller, R. B. (1996). Influences on course achievement: Goals, Perceived ability, and cognitive engagement. Contemporary Educational Psychology, 21, 181–192.
40. Greene, B. A., Miller, R. B., Crowson, H. M., Duke, B. L., & Akey, C. L. (2004). Predicting high school students’ cognitive engagement and achievement: Contributions of classroom perceptions and motivation. Contemporary Educational Psychology, 29, 462–482.
41. Greene, J. A., & Azevedo, R. (2010). The measurement of learners’ self-regulated cognitive and metacognitive processes while using computer-based learning environments. Educational Psychologist, 45, 203–209. http://dx.doi.org/10.1080/00461520.2010.515935.
42. Harackiewicz, J. M., Barron, K. E., Pintrich, P. R., Elliot, A. J., & Thrash, T. M. (2002). Revision of achievement goal theory: Necessary and illuminating. Journal of Educational Psychology, 94, 638–645. http://dx.doi.org/10.1037/0022-0663.94.3.638
43. Heddy, B. C., & Sinatra, G. M. (2013). Transforming misconceptions: Using transformative experience to promote positive affect and conceptual change in students learning about biological evolution, Science Education, 97, 723–744.
44. Hogan, K. (1999). Relating students' personal frameworks for science learning to their cognition in collaborative contexts. Science Education, 83, 1–32.
45. Husman, J., & Lens, W. (1999). The role of the future in student motivation. Educational Psychologist, 34, 113–125.
46. Karabenick, S. A., Woolley, M. E., Friedel, J. M., Ammon, B. V., Blazevski, J., Bonney, C., & Kelly, K. L. (2007). Cognitive processing of self-report items in educational research: Do they think what we mean?. Educational Psychologist, 42, 139–151. http://dx.doi.org/10.1080/00461520701416231
47. Kardash, C. M., & Amlund, J. T. (1991). Self-reported learning strategies and learning from expository text. Contemporary Educational Psychology, 16, 117–138. http://dx.doi.org/10.1016/0361-476X(91)90032-G
48. Kember, D., Biggs, J., & Leung, D. P. (2004). Examining the multidimensionality of approaches to learning through the development of a revised version of the Learning Process Questionnaire. British Journal of Educational Psychology, 74, 261–280. Retrieved from http://dx.doi.org/10.1348/000709904773839879
49. Kintsch, W., & van Dijk, T. A. (1978). Toward a model of text comprehension and production. Psychological Review, 85, 363–394. http://dx.doi.org/10.1037/0033-295X.85.5.363
50. Larson, R., & Csikszentmihalyi, M. (1983). The experience sampling method. New Directions for Methodology of Social and Behavioral Science, 15, 41–56. http://dx.doi.org/10.1017/CBO9780511663246.006
51. Lee, O., & Anderson, C. W. (1993). Task engagement and conceptual change in middle school science classrooms. American Educational Research Journal, 30, 585–610.
52. Lens, W. (1987). Future time perspective, motivation and school performance. In E. De Corte, H. Lodewijks, R. Parmentier, & P. Span (Eds.), Learning and instruction: European research in an international context (Vol. 1, pp. 181–189). Elmsford, NY: Pergamon.
53. Meece, J. L., Blumenfeld, P. C., & Hoyle, R. H. (1988). Student's goal orientations and cognitive engagement in classroom activities. Journal of Educational Psychology, 80, 514–523.
54. Miller, R. B., Behrens, J. T., Greene, B. A., & Newman, D. (1993). Goals and perceived ability: Impact on student valuing, self-regulation and persistence. Contemporary Educational Psychology, 18, 2–14. http://dx.doi.org/10.1006/ceps.1993.1002
55. Miller, R. B., & Brickman, S. J. (2004). A model of future-oriented motivation and self-regulation. Educational Psychology Review 16, 9–33.
56. Miller, R. B., DeBacker, T. K., & Greene, B. A. (1999). Perceived instrumentality and academics: The link to task valuing. Journal of Instructional Psychology, 26, 250–260.
57. Miller, R. B., Greene, B. A., Montalvo, G. P, Ravindran, B., & Nichols, J. D. (1996). Engagement in academic work: The role of learning goals, future consequences, pleasing others and perceived ability. Contemporary Educational Psychology, 21, 388–422. http://dx.doi.org/10.1006/ceps.1996.0028
58. Muis, K. R., Winne, P. H., & Jamieson-Noel, D. (2007). Using a multitrait-multimethod analysis to examine conceptual similarities of three self-regulated learning inventories. British Journal of Educational Psychology, 77, 177–195. http://dx.doi.org/10.1348/000709905´90876
59. Neber, H., & Schommer-Aikins, M. (2002). Self-regulated science learning with highly gifted students: The role of cognitive, motivational, epistemological, and environmental variables. High Ability Studies, 13, 59–74. http://dx.doi.org/10.1080/13598130220132316
60. Nolen, S. B. (1988). Reasons for studying: Motivational orientations and study strategies. Cognition and Instruction, 5, 269–287. http://dx.doi.org/10.1207/s1532690xci0504_2
61. Nolen, S. (2003). Learning environment, motivation, and achievement in high school science. Journal of Research in Science Teaching, 40, 347–368. http://dx.doi.org/10.1002/tea.10080
62. Nolen, S. B., & Haladyna, T. M. (1990a). Motivation and studying in high school science. Journal of Research in Science Teaching, 27, 115–126. http://dx.doi.org/10.1002/tea.3660270204
63. Nolen, S. B., & Haladyna, T. M. (1990b). Personal and environmental influences on students’ beliefs about effective study strategies. Contemporary Educational Psychology, 15, 116–130. http://dx.doi.org/10.1016/0361-476X(90)90011-O
64. Pajares, F. (1996). Self-efficacy beliefs and mathematical problem-solving. Contemporary Educational Psychology, 21, 325–344. http://dx.doi.org/10.1006/ceps.1996.0025
65. Pintrich, P. R. (2000). An achievement goal theory perspective on issues in motivation terminology, theory, and research. Contemporary Educational Psychology, 25, 92–104.
66. Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16, 385–407.
67. Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82, 33–40. http://dx.doi.org/10.1037//0022-0663.82.1.33
68. Pintrich, P. R., & Garcia, T. (1991). Student goal orientation and self-regulation in the college classroom. In M. L. Maehr & P. R. Pintrich (Eds.), Advances in motivation and achievement (Vol. 7, pp. 371–402). Greenwich, CT: JAI.
69. Pintrich, P. R. & Schrauben, B. (1992). Students' motivational beliefs and their cognitive engagement in classroom academic tasks. In D. Schunk & J. Meece (Eds.), Student perceptions in the classroom: Causes and consequences (pp. 149–183). Hillsdale, NJ: Erlbaum.
70. Pugh, K. J., Linnenbrink-Garcia, L., Koskey, K. K., Stewart, V. C., & Manzey, C. (2010). Motivation, learning, and transformative experience: a study of deep engagement in science. Science Education, 94, 1–28. http://dx.doi.org/10.1002/sce.20344
71. Ravindran, B., Greene, B. A., & DeBacker, T. B. (2005). The role of goals and beliefs in the prediction of pre-service teachers’ cognitive engagement and knowledge integration. Journal of Educational Research, 98, 222–232.
72. Raynor,, J. O. (1974a). Future orientation in the study of achievement motivation. In J. W. Atkinson & J. O. Raynor (Eds.), Motivation and achievement (pp. 121–154). New York, NY: V. H. Winston & Sons.
73. Raynor, J. O. (1974b). Relationship between achievement-related motives, future orientation, and academic performance. In J. W. Atkinson & J. O. Raynor (Eds.), Motivation and achievement (pp. 173–180). New York, NY: V. H. Winston & Sons.
74. Raynor, J. O., Atkinson, J. W., & Brown, M. (1974). Subjective aspects of achievement motivation immediately before an examination. In J. W. Atkinson & J. O. Raynor (Eds.), Motivation and achievement (pp. 155–171). New York, NY: Winston & Sons.
75. Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55, 68–78. http://dx.doi.org/10.1037/0003-066X.55.1.68
76. Renninger, K. A., & Bachrach, J. E. (this issue). Studying triggers for interest and engagement using observational methods. Educational Psychologist, 50.
77. Ryu, S., & Lombardi, D. (this issue). Coding classroom interactions for collective and individual engagement. Educational Psychologist, 50.
78. Schmeck, R. R., Ribich, F., & Ramanaiah, N. (1977). Development of a self-report inventory for assessing individual differences in learning processes. Applied Psychological Measurement, 1, 413–431. http://dx.doi.org/10.1177/014662167700100310
79. Schraw, G., Crippen, K. J., & Hartley, K. (2006). Promoting self-regulation in science education: Metacognition as part of a broader perspective on learning. Research in Science Education, 36, 111–139.
80. Schraw, G., & Dennison, R. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19, 460–475.
81. Seifert, T. L. (1993). The effects of elaborative interrogation with prose passages. Journal of Educational Psychology, 85, 642–651. http://dx.doi.org/10.1037/0022-0663.85.4.642
82. Senko, C., Hulleman, C. S., & Harackiewicz, J. M. (2011). Achievement goal theory at the crossroads: Old controversies, current challenges, and new directions. Educational Psychologist, 46, 26–47.
83. Siegler, R.S. (1988). Individual differences in strategy choices: Good students, not-so-good students, and perfectionists. Child Development, 59, 833–851.
84. Sinatra, G. M., Heddy, B. C., Lombardi, D. (this issue). The challenges of defining and measuring student engagement in science. Educational Psychologist, 50.
85. Singh, K., Granville, M., & Dika, S. (2002). Mathematics and science achievement: Effects of motivation, interest, and academic engagement. The Journal of Educational Research, 95, 323–332. http://dx.doi.org/10.1080/00220670209596607.
86. Smart, J. B., & Marshall, J. C. (2013). Interactions between classroom discourse, teacher questioning, and student cognitive engagement in middle school science. Journal of Science Teacher Education, 24, 249–267.
87. Stefanou, C., & Parkes, J. (2003). Effects of classroom assessment on student motivation in fifth-grade science. The Journal of Educational Research, 96, 152–162. http://dx.doi.org/10.1080/00220670309598803
88. Sternberg, R. J. (1988). Mental self-government: A theory of intellectual styles and their development. Human Development, 31, 197–224.
89. Thomas, M. K., Ge, X., & Greene, B. A. (2011). Fostering 21st Century skill development by engaging students in authentic game design projects in a high school computer programming class. Journal of Educational Computing Research, 44, 391–408.
90. van Gog, T., Kester, L., & Paas, F. (2011). Effects of worked examples, example-problem, and problem-example pairs on novices' learning. Contemporary Educational Psychology, 36, 212–218. http://dx.doi.org/10.1016/j.cedpsych.2010.10.004
91. VanderStoep, S., Pintrich, P. R., & Fagerlin, A. (1996). Disciplinary differences in self-regulated learning in college students. Contemporary Educational Psychology, 21, 345–362.
92. Walden, S. E., Greene, B. A., Slater, J., Lubin, I., & Keesee, M. S. (2009, August). Collaboration between science teachers and university scientists: Inquiry-oriented professional development. Paper presented at the 2009 Biennial Conference Meeting of the European Association for Research on Learning and Instruction, Amsterdam, The Netherlands.
93. Walker, C. O., & Greene, B. A. (2009). The relations between student motivational beliefs and cognitive engagement in high school. Journal of Educational Research, 102, 463–472.
94. Walker, C., Greene, B. A., & Mansell, R. A. (2006). Identification with academics, intrinsic/extrinsic motivation, and self-efficacy as predictors of cognitive engagement. Learning and Individual Differences, 16, 1–12.
95. Weiner, B. (1972). Attribution theory, achievement motivation, and the educational process. Review of Educational Research, 42, 203–215. http://dx.doi.org/10.3102/00346543042002203
96. Weinstein, C. E. (1987). LASSI user's manual. Clearwater, FL: H & H.
97. Weinstein, C. E., Palmer, D. R., & Schulte, A. C. (1987). LASSI: Learning and Study Strategies Inventory. Clearwater, FL: H & H.
98. Winne, P. H. (2010). Improving measurements of self-regulated learning. Educational Psychologist, 45, 267–276. http://dx.doi.org/10.1080/00461520.2010.517150
99. Wolters, C. A. (2004). Advancing achievement goal theory: Using goal structures and goal orientations to predict students' motivation, cognition, and achievement. Journal of Educational Psychology, 96, 236–250. http://dx.doi.org/10.1037/0022-0663.96.2.236
100. Wolters, C. A., & Pintrich, P. R. (1998). Contextual differences in student motivation and self-regulated learning in mathematics, English, and social studies classrooms. Instructional Science, 26, 27–47.
101. Wolters, C., Pintrich, P. R., & Karabenick, S. A. (2005). Assessing academic self-regulated learning. In K. A. Moore & L. Lippman (Eds.), Conceptualizing and measuring indicators of positive development: What do children need to flourish? (pp. 251–270). New York, NY: Kluwer Academic/Plenum.
102. Zhu, E. (2006). Interaction and cognitive engagement: An analysis of four asynchronous online discussions. Instructional Science: An International Journal of Learning and Cognition, 34, 451–480.
103. Zimmerman, B., & Martinez-Pons, M. (1988). Construct validation of a strategy model of student self-regulated learning. Journal of Educational Psychology, 80, 284–290.
104. Zimmerman, B. J., & Martinez-Pons, M. (1990). Student differences in self-regulated learning: Relating grade, sex, and giftedness to self-efficacy and strategy use. Journal of Educational Psychology, 82, 51–59.