Metacognition in computation: A selected research review

Artificial Intelligence

Volumn 169, Issue 2, 2005, Pages 104-141

  Cox, Michael T ^a  

^a BBN TECHNOLOGIES   (United States)

Author keywords

Cognitive monitoring; Computational introspection; Limited rationality; Meta explanation; Meta level architecture; Metacognition; Metaknowledge; Metareasoning; Reflection; Self reference

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL METHODS; COMPUTER SCIENCE; KNOWLEDGE BASED SYSTEMS; REFLECTION;

COGNITIVE MONITORING; COMPUTATIONAL INTROSPECTION; LIMITED RATIONALITY; META-EXPLANATION; META-LEVEL ARCHITECTURE; METACOGNITION; METAKNOWLEDGE; METAREASONING; SELF-REFERENCE;

COGNITIVE SYSTEMS;

EID: 27944457938     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2005.10.009     Document Type: Review

References (241)

1. J.R. Anderson The Architecture of Cognition 1983 Harvard Univ. Press Cambridge, MA
2. J.R. Anderson, and R. Thompson Use of analogy in a production system architecture S. Vosniadou A. Ortony Similarity and Analogical Reasoning 1989 Cambridge Univ. Press Cambridge 267 297
3. M.L. Anderson, How to study the mind: An introduction to embodied cognition, in: F. Santoianni, C. Sabatano (Eds.), Brain Development in Learning Environments: Embodied and Perceptual Advancements, Cambridge Univ. Press, New York, in press
4. M.L. Anderson Embodied cognition: A field guide Artificial Intelligence 149 1 2003 91 130
5. M.L. Anderson T. Oates Metacognition in Computation: Papers from 2005 AAAI Spring Symposium 2005 AAAI Press Menlo Park, CA AAAI Technical Report SS-05-04
6. M.L. Anderson, and D.R. Perlis Logic, self-awareness and self-improvement: The metacognitive loop and the problem of brittleness J. Logic Comput. 15 1 2005 21 40
7. M.L. Anderson, D.R. Perlis, The roots of self-awareness, in: Phenomenology and the Cognitive Sciences, in press
8. C. Antaki A. Lewis Mental Mirrors: Metacognition in Social Knowledge and Communication 1986 Sage Publications London
9. G. Attardi, and M. Simi Reflections about reflection J. Allen R. Fikes E. Sandewall Principles of Knowledge Representation and Reasoning: Proceedings of the 2nd International Conference (KR91) 1991 Morgan Kaufmann San Mateo, CA
10. A. Augustine De Trinitate J. Burnaby Augustine: Later Works Library of Christian Classics, Bk. 10, Sec. 7 vol. 8 1955 SCM Press Transl. by J. Burnaby, original work published around 1600
11. A. Barr, Meta-knowledge and memory, Technical Report, HPP-77-37, Stanford University, Department of Computer Science, Stanford, CA, 1977
12. A. Barr Meta-knowledge and cognition Proceedings of the Sixth International Joint Conference on Artificial Intelligence 1979 Morgan Kaufmann Los Altos, CA 31 33
13. J. Batali, Computational introspection, Technical Report, 701, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, 1983
14. B. Berardi-Coletta, L.S. Buyer, R.L. Dominowski, and R.E. Rellinger Metacognition and problem-solving: A process-oriented approach J. Experimental Psychology: Learning, Memory, and Cognition 21 1 1995 205 223
15. C. Bessiere, E.C. Freuder, and J.-C. Regin Using constraint metaknowledge to reduce arc consistency computation Artificial Intelligence 107 1999 125 148
16. S. Bhatta, Model-based analogy in innovative device design, Ph.D. Dissertation, College of Computing, Georgia Institute of Technology, Atlanta, 1995
17. S. Bhatta, A. Goel, Use of mental models for constraining index learning in experience-based design, in: Proceedings of the AAAI-92 Workshop on Constraining Learning with Prior Knowledge, 1992
18. L. Birnbaum, G. Collins, M. Freed, and B. Krulwich Model-based diagnosis of planning failures Proceedings of the Eighth National Conference on Artificial Intelligence 1990 AAAI Press Menlo Park, CA 318 323
19. A. Bonzano, P. Cunningham, and B. Smyth Using introspective learning to improve retrieval in CBR: A case study in air traffic control D.B. Leake E. Plaza Case-Based Reasoning Research and Development: Second International Conference on Case-Based Reasoning 1997 Springer Berlin 291 301
20. E.G. Boring A history of introspection Psychological Bull. 50 3 1953 169 189
21. B. Bouzy, and T. Cazenave Computer Go: An AI oriented survey Artificial Intelligence 132 2001 39 103
22. R.J. Brachman Systems that know what they are doing IEEE Intelligent Systems Nov/Dec. 2002 67 71
23. P.B. Brazdil K. Konolige Machine Learning, Meta-Reasoning and Logics 1990 Kluwer Academic Norwell, MA
24. A. Brown Metacognition, executive control, self-regulation, and other more mysterious mechanisms F.E. Weinert R.H. Kluwe Metacognition, Motivation, and Understanding 1987 LEA Hillsdale, NJ 65 116
25. B.G. Buchanan Creativity at the meta-level: AAAI-2000 presidential address AI Magazine 22 3 2000 13 28
26. J.G. Carbonell Derivational analogy: A theory of reconstructive problem solving and expertise acquisition R. Michalski J. Carbonell T. Mitchell Machine Learning: An Artificial Intelligence Approach, vol. 2 1986 Morgan Kaufmann San Mateo, CA 371 392
27. J.G. Carbonell, C.A. Knoblock, and S. Minton PRODIGY: An integrated architecture for planning and learning K. VanLehn Architectures of Cognition: The 22nd Carnegie Mellon Symposium on Cognition 1991 LEA Hillsdale, NJ 241 278
28. T. Cazenave Metarules to improve tactical go knowledge Inform. Sci. 154 3-4 2003 173 188
29. S.J. Ceci Handbook of Cognitive, Social, and Neuropsychological Aspects of Learning Disabilities, vol. 2 1987 LEA Hillsdale, NJ
30. J. Cheng, Management of speedup mechanisms in learning architectures, Technical Report, CMU-CS-95-112, Ph.D. Dissertation, School of Computer Science, Carnegie Mellon University, Pittsburgh, 1995
31. M.T.H. Chi Representing knowledge and metaknowledge: Implications for interpreting metamemory research F.E. Weinert R.H. Kluwe Metacognition, Motivation, and Understanding 1987 LEA Hillsdale, NJ 239 266
32. M.T.H. Chi, Revising the mental model as one learns, Plenary address to the Seventeenth Annual Conference of the Cognitive Science Society, Pittsburgh, July 23, 1995
33. M.T.H. Chi, M. Bassok, M. Lewis, P. Reimann, and R. Glasser Self-explanations: How students study and use examples in learning to solve problems Cognitive Science 13 1989 145 182
34. W.J. Clancey, The knowledge engineer as student: metacognitive bases for asking good questions, Technical Report, STAN-CS-87-1183, Department of Computer Science, Stanford University, Stanford, CA, 1987
35. W.J. Clancey Model construction operators Artificial Intelligence 53 1992 1 115
36. W.J. Clancey, C. Bock, Representing control knowledge as abstract task and metarules, Technical Report, STAN-CS-87-1168, Department of Computer Science, Stanford University, Stanford, CA, 1985
37. P. Cointe Meta-Level Architectures and Reflection: Second International Conference, Reflection '99 1999 Springer Berlin
38. G. Collins, Plan creation: Using strategies as blueprints, Technical Report, 599, Ph.D. Dissertation, Department of Computer Science, Yale University, New Haven, CT, 1987
39. G. Collins, L. Birnbaum, B. Krulwich, and M. Freed The role of self-models in learning to plan A. Meyrowitz Machine Learning: Induction, Analogy and Discovery 1993 Kluwer Academic Boston
40. V. Conitzer, and T. Sandholm Definition and complexity of some basic metareasoning problems G. Gottlob T. Walsh Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI-03) 2003 Morgan Kaufmann San Francisco, CA 1099 1106
41. S. Costantini Meta-reasoning: A survey A. Kakas F. Sadri Computational Logic: From Logic Programming into the Future (Special volume in honour of Bob Kowalski) 2002 Springer Berlin
42. M.T. Cox Machines that forget: Learning from retrieval failure of mis-indexed explanations A. Ram K. Eiselt Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society 1994 LEA Hillsdale, NJ 225 230
43. M.T. Cox, Metacognition, problem solving and aging, Cognitive Science Tech. Rep. No. 15, Atlanta, Georgia Institute of Technology, College of Computing, 1994
44. M.T. Cox Representing mental events (or the lack thereof) M.T. Cox M. Freed Proceedings of the 1995 AAAI Spring Symposium on Representing Mental States and Mechanisms 1995 AAAI Press Menlo Park, CA 22 30 Available as Technical Report SS-95-08
45. M.T. Cox An empirical study of computational introspection: Evaluating introspective multistrategy learning in the meta-AQUA system R.S. Michalski J. Wnek Proceedings of the Third International Workshop on Multistrategy Learning 1996 AAAI Press/MIT Press Menlo Park, CA 135 146
46. M.T. Cox, Introspective multistrategy learning: Constructing a learning strategy under reasoning failure, Technical Report, GIT-CC-96-06. Ph.D. Dissertation, College of Computing, Georgia Institute of Technology, Atlanta, 1996, hcs.bbn.com/cox/thesis/
47. M.T. Cox An explicit representation of reasoning failures D.B. Leake E. Plaza Case-Based Reasoning Research and Development: Second International Conference on Case-Based Reasoning 1997 Springer Berlin 211 222
48. M.T. Cox Loose coupling of failure explanation and repair: Using learning goals to sequence learning methods D.B. Leake E. Plaza Case-Based Reasoning Research and Development: Second International Conference on Case-Based Reasoning 1997 Springer Berlin 425 434
49. M.T. Cox Perpetual self-aware cognitive agents M. Anderson T. Oates Metacognition in Computation: Papers from 2005 AAAI Spring Symposium 2005 AAAI Press Menlo Park, CA 42 48 Technical Report SS-05-04
50. M.T. Cox, and M. Freed Using knowledge from cognitive behavior to learn from failure J.W. Brahan G.E. Lasker Proceedings of the Seventh International Conference on Systems Research, Informatics and Cybernetics, vol. 2, Advances in Artificial Intelligence - Theory and Application II 1994 The International Institute for Advanced Studies in Systems Research and Cybernetics Windsor, Ontario, Canada 142 147
51. M.T. Cox M. Freed Proceedings of the 1995 AAAI Spring Symposium on Representing Mental States and Mechanisms 1995 AAAI Press Menlo Park, CA Technical Report SS-95-08
52. M.T. Cox, and A. Ram Using introspective reasoning to select learning strategies R.S. Michalski G. Tecuci Proceedings of the First International Workshop on Multistrategy Learning 1991 George Mason University, Artificial Intelligence Center Washington, DC 217 230
53. M.T. Cox, and A. Ram Multistrategy learning with introspective meta-explanations D. Sleeman P. Edwards Machine Learning: Ninth International Conference 1992 Morgan Kaufmann San Mateo, CA 123 128
54. M.T. Cox, and A. Ram Interacting learning-goals: Treating learning as a planning task J.-P. Haton M. Keane M. Manago Advances in Case-Based Reasoning 1995 Springer Berlin 60 74
55. M.T. Cox, and A. Ram Introspective multistrategy learning: On the construction of learning strategies Artificial Intelligence 112 1999 1 55
56. L. Coyle, P. Cunningham, Improving recommendation rankings by learning personal feature weights, Technical Report TCD-CS-2004-21. The University of Dublin, Trinity College, Ireland, 2004
57. J.E. Davidson, R. Deuser, and R.J. Sternberg The role of metacognition in problem solving J. Metcalfe A.P. Shimamura Metacognition 1994 The MIT Press Cambridge, MA 207 226
58. D.N. Davis, Visions of Mind: Architectures for Cognition and Affect, Idea Group Inc, Hershey, PA, in press
59. R. Davis, Applications of meta-level knowledge to the construction, maintenance, and use of large knowledge bases, Stanford HPP Memo 76-7, Stanford University, 1976
60. R. Davis Interactive transfer of expertise: Acquisition of new inference rules Artificial Intelligence 12 1979 121 157
61. R. Davis Meta-rules: Reasoning about control Artificial Intelligence 15 1980 179 222
62. R. Davis, and B. Buchanan Meta-level knowledge: Overview and applications Proceedings of the Fifth International Joint Conference on Artificial Intelligence 1977 Morgan Kaufmann Los Altos, CA 920 927
63. T. Dean, and M. Boddy An analysis of time-dependent planning T.M. Mitchell R.G. Smith Proceedings of the Seventh National Conference on Artificial Intelligence 1988 AAAI Press Menlo Park, CA 49 54
64. J. de Kleer, and J.S. Brown Assumptions and ambiguities in mechanistic mental models A. Collins E.E. Smith Readings in Cognitive Science: A Perspective from Psychology and Artificial Intelligence 1988 Morgan Kaufmann San Mateo, CA 49 54 Original work published 1983
65. J. de Kleer How circuits work Artificial Intelligence 24 1984 205 280
66. J. de Kleer, J. Doyle, G.L. Steele, and G.J. Sussman Explicit control of reasoning SIGPLAN Notices 12 1977
67. V.R. Delclos, and C. Harrington Effects of strategy monitoring and proactive instruction on children's problem-solving performance J. Educational Psychology 83 1 1991 35 42
68. D.C. Dennett Brainstorms: Philosophical Essays on Mind and Psychology 1978 MIT Press/Bradford Books Cambridge, MA
69. S.J. Derry Strategy and expertise in solving word problems C.B. McCormick G.E. Miller M. Pressley Cognitive Strategy Research: From Basic Research to Educational Applications 1989 Springer Berlin 269 302
70. R.L. Dominowski Verbalization and problem solving D.L. Hacker J. Dunlosky A. Graesser Metacognition in Educational Theory and Practice 1998 Lawrence Erlbaum Associates Mahwah, NJ 25 45
71. D. Dörner Self-reflection and problem-solving F. Klix Human and Artificial Intelligence 1979 North-Holland Amsterdam 101 107
72. J. Doyle A truth maintenance system Artificial Intelligence 12 1979 231 272
73. J. Doyle, A model for deliberation, action, and introspection, Technical Report, TR-581, Ph.D. Dissertation, Department of Computer Science, Massachusetts Institute of Technology, Cambridge, MA, 1980
74. A. Dunlosky Metacognition A. Hunt A. Ellis Fundamentals of Cognitive Psychology seventh ed. 2004 McGraw-Hill New York 232 262
75. J. Elgot-Drapkin, and D. Perlis Reasoning situated in time I: Basic concepts J. Experiment. Theoret. Artificial Intelligence 2 1990 75 98
76. R.L. Epstein, and W.A. Carnielli Computability: Computable Functions, Logic, and the Foundations of Mathematics 1989 Wadsworth and Brooks Pacific Grove, CA
77. O. Etzioni Embedding decision-analytic control in a learning architecture Artificial Intelligence 49 1991 129 159
78. E. Fink, Automatic representation changes in problem solving, Technical Report, CMU-CS-99-150, Ph.D. Thesis, Computer Science Department, Carnegie Mellon University, 1999
79. E. Fink, How to solve it automatically: Selection among problem-solving methods, in: Proceedings of the Fourth International Conference on Artificial Intelligence Planning Systems, 1998, pp. 128-136
80. J.H. Flavell First discussant's comments: What is memory development the development of? Human Development 14 1971 272 278
81. J.H. Flavell Metacognitive aspects of problem solving A. Resnick The Nature of Intelligence 1976 LEA Hillsdale, NJ 231 235
82. J.H. Flavell, and H.M. Wellman Metamemory R.V. Kail J.W. Hagen Perspectives on the Development of Memory and Cognition 1977 LEA Hillsdale, NJ 3 33
83. K. Forbus, T. Hinrichs, Companion cognitive systems: A step towards human-level AI, in: AAAI Fall Symposium on Achieving Human-level Intelligence through Integrated Systems and Research, Washington, DC, October 2004
84. D.L. Forrest-Pressley G.E. MacKinnon T.G. Waller Metacognition, Cognition and Human Performance (vol. 2, Instructional Practices) 1985 Academic Press New York
85. S. Fox, Introspective learning for case-based planning, Unpublished, Ph.D. Dissertation, Department of Computer Science, Indiana University, Bloomington, IN, 1995
86. S. Fox, and D. Leake Modeling case-based planning for repairing reasoning failures M.T. Cox M. Freed Proceedings of the 1995 AAAI Spring Symposium on Representing Mental States and Mechanisms 1995 AAAI Press Menlo Park, CA 31 38 Available as Technical Report SS-95-08
87. S. Fox, and D. Leake Using introspective reasoning to refine indexing C.S. Mellish Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence 1995 Morgan Kaufmann San Mateo, CA 391 397
88. S. Fox, and D. Leake Introspective reasoning for index refinement in case-based reasoning J. Experiment. Theoret. Artificial Intelligence 13 2001 63 88
89. M. Freed, and G. Collins Learning to cope with task interactions A. Ram M. desJardins Proceedings of the 1994 AAAI Spring Symposium on Goal-Driven Learning 1994 AAAI Press Menlo Park, CA 28 35
90. M. Freed, B. Krulwich, L. Birnbaum, and G. Collins Reasoning about performance intentions Proceedings of Fourteenth Annual Conference of the Cognitive Science Society 1992 LEA Hillsdale, NJ 7 12
91. B. Fischhoff, P. Slovic, and S. Lichtenstein Knowing with certainty: The appropriateness of extreme confidence J. Experimental Psychol.: Human Perception and Performance 3 4 1977 552 564
92. R. Garner Metacognition and Reading Comprehension 1987 Ablex Publishing Corporation Norwood, NJ
93. J.R. Gavelek, and T.E. Raphael Metacognition, instruction, and the role of questioning activities D.L. Forrest-Pressley G.E. MacKinnon T.G. Waller Metacognition, Cognition and Human Performance (vol. 2, Instructional Practices) 1987 Academic Press New York 103 136
94. M.R. Genesereth An overview of meta-level architecture Proceedings of the Third National Conference on Artificial Intelligence 1983 William Kaufmann Los Altos, CA 119 123
95. A.M. Glenberg, A.C. Wilkinson, and W. Epstein The illusion of knowing: Failure in the self-assessment of comprehension T.O. Nelson Metacognition: Core Readings 1992 Allyn and Bacon Boston 185 195 Original work published 1982
96. S. Ghetti Memory for nonoccurrences: The role of metacognition J. Memory and Language 48 4 2003 722 739
97. J.E. Gombert Metalinguistic Development 1992 University of Chicago Press Chicago
98. I.J. Good Twenty-seven principles of rationality V.P. Godambe D.A. Sprott Foundations of Statistical Inference 1971 Hold Rinehart, Winston, Toronto
99. A.S. Gordon Strategy Representation: An Analysis of Planning Knowledge 2004 LEA Mahwah, NJ
100. A.S. Gordon, and J.R. Hobbs Formalizations of commonsense psychology AI Magazine 25 4 2004 49 62
101. K.J. Hammond Case-based Planning: Viewing Planning as a Memory Task, vol. 1, Perspectives in Artificial Intelligence 1989 Academic Press San Diego, CA
102. K.J. Hammond Explaining and repairing plans that fail Artificial Intelligence 45 1990 173 228
103. E.A. Hansen, and S. Zilberstein Monitoring anytime algorithms ACM SIGART Bull. 7 2 1996 28 33
104. E.A. Hansen, and S. Zilberstein Monitoring and control of anytime algorithms: A dynamic programming approach Artificial Intelligence 126 1-2 2001 139 157
105. D. Harada, and S.J. Russell Extended abstract: Learning search strategies W. Zhang S. Koenig Search Techniques for Problem Solving under Uncertainty and Incomplete Information: Papers from the AAAI Spring Symposium 1999 AAAI Press Menlo Park, CA 48 52 AAAI Technical Report SS-99-07
106. J. Haugeland Artificial Intelligence: The Very Idea 1985 MIT Press Cambridge, MA
107. P.J. Hayes The logic of frames B.L. Webber N.J. Nilsson Readings in Artificial Intelligence 1981 Morgan Kaufmann Los Altos, CA 451 458 Original work published 1979
108. F. Hayes-Roth D.A. Waterman D.B. Lenat Building Expert Systems 1983 Addison-Wesley London
109. J.R. Hobbs, and A.S. Gordon Toward a large-scale formal theory of commonsense psychology for metacognition M. Anderson T. Oates Metacognition in Computation: Papers from 2005 AAAI Spring Symposium 2005 AAAI Press Menlo Park, CA 49 54 Technical Report SS-05-04
110. D.R. Hofstadter Gödel, Escher, Bach: An Eternal Golden Braid 1989 Vintage Books New York Original work published in 1979
111. J. Horty Y. Shoham Proceedings of the 1993 AAAI Spring Symposium on Reasoning about Mental States: Formal Theories and Applications 1993 AAAI Press Menlo Park, CA
112. E. Horvitz Reasoning about beliefs and actions under computational resource constraints Proceedings of the Third Workshop on Uncertainty in Artificial Intelligence, Seattle, Washington 1987 429 444
113. Also L. Kanal T. Levitt J. Lemmer Uncertainty in Artificial Intelligence 3 1990 Elsevier Amsterdam 301 324
114. E.J. Horvitz, G. Cooper, and D. Heckerman Reflection and action under scarce resources: Theoretical principles and empirical study Proceedings of the Eleventh International Joint Conference on Artificial Intelligence 1989 Morgan Kaufmann Los Altos, CA
115. E. Horvitz, and S. Zilberstein Special issue on computational tradeoffs under bounded resources Artificial Intelligence 126 1-2 2001
116. E. Hudlicka Modeling interaction between metacognition and emotion in cognitive architectures M. Anderson T. Oates Metacognition in Computation: Papers from 2005 AAAI Spring Symposium 2005 AAAI Press Menlo Park, CA 55 61 Technical Report SS-05-04
117. P.N. Johnson-Laird Mental Models: Toward a Cognitive Science of Language, Inference, and Consciousness 1983 Cambridge University Press Cambridge
118. P.N. Johnson-Laird The Computer and the Mind: An Introduction to Cognitive Science 1988 Harvard University Press Cambridge, MA
119. A. Kass, Developing creative hypotheses by adapting explanations, Ph.D. Dissertation, The Institute for the Learning Sciences, Northwestern University, Evanston, IL, 1990
120. F. Keil, L. Rosenblit, and C.M. Mills What lies beneath? Understanding the limits of understanding D.T. Levin Thinking and Seeing 2004 MIT Press Cambridge, MA 227 249
121. J.L. Kolodner Case-Based Reasoning 1993 Morgan Kaufmann San Mateo, CA
122. K. Konolige A Computational theory of belief introspection Proceedings of the Ninth International Joint Conference on Artificial Intelligence 1985 Morgan Kaufmann Los Altos, CA 502 508
123. K. Konolige A Deduction Model of Belief 1986 Morgan Kaufmann Los Altos, CA
124. K. Konolige Reasoning by introspection P. Maes D. Nardi Meta-Level Architectures and Reflection 1988 North-Holland Amsterdam 61 74
125. B. Krulwich, Determining what to learn in a multi-component planning system, in: Proceedings of the Thirteenth Annual Conference of the Cognitive Science Society, Chicago, IL, August 7-10, 1991, pp. 102-107
126. B. Krulwich, Flexible learning in a multicomponent planning system, Technical Report, 46, Ph.D. Dissertation, The Institute for the Learning Sciences, Northwestern University, Evanston, IL, 1993
127. D.R. Kuokka, The deliberative integration of planning, execution, and learning, Technical Report, CMU- CS-90-135, Ph.D. Dissertation, Computer Science Dept., Carnegie Mellon University, Pittsburgh, 1990
128. J.L. Lachman, R. Lachman, and C. Thronesbery Metamemory through the adult life span Developmental Psychology 15 5 1979 543 551
129. R. Laddaga, Self-adaptive software, DARPA Solicitation BAA 98-12, 1998
130. M.G. Lagoudakis, M.L. Littman, and R. Parr Selecting the right algorithm C. Gomes T. Walsh Proceedings of the 2001 AAAI Fall Symposium Series: Using Uncertainty within Computation 2001 AAAI Press Menlo Park, CA
131. M.G. Lagoudakis, R. Parr, and M.L. Littman Least-squares methods in reinforcement learning for control Proceedings of the 2nd Hellenic Conference on Artificial Intelligence Lecture Notes on Artificial Intelligence vol. 2308 2002 Springer Berlin 249 260
132. D.B. Leake Case-Based Reasoning: Experiences, Lessons, & Future Directions 1996 AAAI Press/MIT Press Menlo Park, CA
133. D.B. Leake Experience, introspection, and expertise: Learning to refine the case-based reasoning process J. Experiment. Theoret. Artificial Intelligence 8 3-4 1996 319 339
134. D.B. Lenat, R. Davis, J. Doyle, M. Genesereth, I. Goldstein, and H. Schrobe Reasoning about reasoning F. Hayes-Roth D.A. Waterman D.B. Lenat Building Expert Systems 1983 Addison-Wesley London 219 239
135. D.T. Levin Thinking and Seeing 2004 MIT Press Cambridge, MA
136. D.T. Levin, and M.R. Beck Thinking about seeing: spanning the difference between metacognitive failure and success D.T. Levin Thinking and Seeing 2004 MIT Press Cambridge, MA 121 143
137. W. Lyons The Disappearance of Introspection 1986 Bradford Books/MIT Press Cambridge, MA
138. P. Maes, Computational reflection, Technical Report, 87-2, Ph.D. Dissertation, Artificial Intelligence Laboratory, Vrije Universiteit Brussels, Belgium, 1987
139. P. Maes Introspection in knowledge representation B. Du Boulay D. Hogg L. Steels Advances in Artificial Intelligence - II 1987 North-Holland Amsterdam 249 262
140. P. Maes Issues in computational reflection P. Maes D. Nardi Meta-Level Architectures and Reflection 1988 North-Holland Amsterdam 21 35
141. P. Maes D. Nardi Meta-Level Architectures and Reflection 1988 North-Holland Amsterdam
142. J. Marshall, Metacat: A self-watching cognitive architecture for analogy-making and high-level perception, Ph.D. Dissertation, Indiana University, Bloomington, 1999
143. J. Marshall, and D. Hofstadter Making sense of analogies in Metacat K. Holyoak D. Gentner B. Kokinov Advances in Analogy Research: Integration of Theory and Data from the Cognitive, Computational, and Neural Sciences 1998 Springer Berlin
144. C. Mason, Introspection as control in result-sharing assumption-based reasoning agents, in: International Workshop on Distributed Artificial Intelligence, Lake Quinalt, WA, 1994
145. J. McCarthy Programs with common sense Symposium Proceedings on Mechanisation of Thought Processes, vol. 1 1959 Her Majesty's Stationary Office London 77 84
146. J. McCarthy Programs with common sense M.L. Minsky Semantic Information Processing 1968 MIT Press Cambridge, MA 403 418
147. J. McCarthy Ascribing mental qualities to machines M. Ringle Philosophical Perspectives in Artificial Intelligence 1979 Humanities Press Atlantic Highlands, NJ 161 195
148. J. McCarthy Notes on formalizing context R. Bajcsy Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, vol. 1 1993 Morgan Kaufmann San Mateo, CA 555 560
149. J. McCarthy Making robots conscious of their mental states M.T. Cox M. Freed Proceedings of the 1995 AAAI Spring Symposium on Representing Mental States and Mechanisms 1995 AAAI Press Menlo Park, CA 89 96 Available as Technical Report SS-95-08
150. J. McCarthy (chair), V. Chaudri (co-chair), DARPA Workshop on Self Aware Computer Systems, SRI Headquarters, Arlington, VA, April 27-28, 2004
151. J. McCarthy, and P. Hayes Some philosophical problems from the standpoint of artificial intelligence Machine Intelligence 4 1969 463 502
152. J. McCarthy, M. Minsky, A. Sloman, L. Gong, T. Lau, L. Morgenstern, E. Meuller, D. Riecken, M. Singh, and P. Singh An architecture of diversity for commonsense reasoning IBM Systems J. 41 3 2002 530 539
153. T.P. McNamara, D.L. Miller, and J.D. Bransford Mental models and reading comprehension R. Barr M.L. Kamil P. Mosenthal P.D. Pearson Handbook of Reading Research, vol. 2 1991 Longman New York 490 511
154. J. Metcalfe Metamemory: Theory and data E. Tulving F.I.M. Craik The Oxford Handbook of Memory 2000 Oxford University Press New York 197 211
155. J. Metcalfe Cognitive optimism: self-deception or memory-based processing heuristics? J. Metcalfe Personality and Social Psychology Review 2 2 1998 100 110 special issue: Metacognition
156. J. Metcalfe Special issue: Metacognition Personality and Social Psychology Review 2 2 1998
157. T. Metzinger, and D.J. Chalmers Selected Bibliography, Consciousness in Philosophy, Cognitive Science and Neuroscience: 1970-1995 1995 Imprint Academic Schoning, UK Appendix I in: T. Metzinger (Ed.), Conscious Experience
158. A.C. Miner, and L.M. Reder A new look at feeling of knowing: Its metacognitive role in regulating question answering J. Metcalfe A.P. Shimamura Metacognition: Knowing about Knowing 1994 MIT Press/Bradford Books Cambridge, MA 47 70
159. M.L. Minsky Steps towards artificial intelligence E.A. Feigenbaum J. Feldman Computers and Thought 1963 McGraw-Hill New York 406 450 Original work published 1961
160. M.L. Minsky, Matter, mind, and models, in: Proceedings of the International Federation of Information Processing Congress, vol. 1, 1965, pp. 45-49
161. M.L. Minsky Matter, mind, and models M.L. Minsky Semantic Information Processing 1968 MIT Press Cambridge, MA 425 432
162. M.L. Minsky Semantic Information Processing 1968 MIT Press Cambridge, MA
163. M.L. Minsky The Society of Mind 1985 Simon and Schuster New York
164. M. Minsky, P. Singh, and A. Sloman The St. Thomas common sense symposium: Designing architectures for human-level intelligence AI Magazine 2004 113 124
165. S. Minton Learning Search Control Knowledge: A Explanation-Based Approach 1988 Kluwer Academic Boston
166. T.M. Mitchell, J. Allen, P. Chalasani, J. Cheng, O. Etzioni, M. Ringuette, and J.C. Schlimmer Theo: A framework for self-improving systems K. VanLehn Architectures of Cognition: The 22nd Carnegie Mellon Symposium on Cognition 1991 LEA Hillsdale, NJ 323 355
167. T.M. Mitchell, R. Keller, and S. Kedar-Cabelli Explanation-based generalization: A unifying view Machine Learning 1 1 1986 47 80
168. R. Mooney, and D. Ourston A multistrategy approach to theory refinement R.S. Michalski G. Tecuci Machine Learning IV: A Multistrategy Approach 1994 Morgan Kaufmann San Francisco, CA 141 164
169. R.C. Moore Semantical considerations on nonmonotonic logic Artificial Intelligence 25 1 1985 75 94
170. R.C. Moore Logic and Representation 1995 CSLI Publications Stanford, CA
171. J.W. Murdock, A theory of reflective agent evolution, Technical Report, GIT-CC-98-27, Ph.D. Proposal, College of Computing, Georgia Institute of Technology, Atlanta, 1998
172. J.W. Murdock, and A. Goel Meta-case-based reasoning: Using functional models to adapt case-based agents D.W. Aha I. Watson Q. Yang Case-Based Reasoning Research and Development: Proceedings of the 4th International Conference on Case-Based Reasoning, ICCBR-2001 2001 Springer Berlin 407 421
173. T.O. Nelson, and L. Narens Metamemory: A theoretical framework and new findings T.O. Nelson Metacognition: Core Readings 1992 Allyn and Bacon Boston 9 24 Originally published in 1990
174. A. Newell The knowledge level Artificial Intelligence 18 1982 87 127
175. A. Newell Unified Theories of Cognition 1990 Harvard University Press Cambridge, MA
176. N. Nilsson Principles of Artificial Intelligence 1980 Morgan Kaufmann Los Altos, CA
177. R.E. Nisbett, and T. Wilson Telling more than we can know: Verbal reports on mental processes Psychological Rev. 84 3 1977 231 259
178. R. Oehlmann Metacognitive and computational aspects of chance discovery New Gen. Comput. 21 1 2003 3 12
179. R. Oehlmann, P. Edwards, and D. Sleeman Changing the viewpoint: Re-indexing by introspective questioning A. Ram K. Eiselt Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society 1994 LEA Hillsdale, NJ 675 680
180. R. Oehlmann, P. Edwards, and D. Sleeman Introspection planning: Representing metacognitive experience M.T. Cox M. Freed Proceedings of the 1995 AAAI Spring Symposium on Representing Mental States and Mechanisms 1995 AAAI Press Menlo Park, CA 102 110 Available as Technical Report SS-95-08
181. C. Owens, Indexing and retrieving abstract planning knowledge, Ph.D. Dissertation, Department of Computer Science, Yale University, New Haven, 1990
182. D. Perlis Languages with self-reference I: Foundations Artificial Intelligence 25 1985 301 322
183. D. Perlis Languages with self-reference II: Knowledge, belief and modality Artificial Intelligence 34 2 1988 179 212
184. D. Perlis, Theory and application of self-reference: Logic and beyond, CSLI, in press
185. P. Pirolli, and M. Recker Learning strategies and transfer in the domain of programming Cognition and Instruction 12 3 1994 235 275
186. J.L. Pollock How to Build a Person 1989 MIT Press/Bradford Books Cambridge, MA
187. J.L. Pollock OSCAR: A general theory of rationality J. Experiment. Theoret. Artificial Intelligence 1 1989 209 226
188. M. Pressley, and D. Forrest-Pressley Questions and children's cognitive processing A.C. Graesser J.B. Black The Psychology of Questions 1985 LEA Hillsdale, NJ 277 296
189. A. Raja, Meta-level control in multi-agent systems, Ph.D. Dissertation, Department of Computer Science, University of Massachusetts, Amherst, MA, 2003
190. A. Raja, and V. Lessor Meta-level reasoning in deliberative agents Proceedings of the International Conference on Intelligent Agent Technology 2004 IEEE Computer Society Piscataway, NJ 141 147
191. A. Ram Indexing, elaboration and refinement: Incremental learning of explanatory cases Machine Learning 10 1993 201 248
192. A. Ram AQUA: Questions that drive the understanding process R.C. Schank A. Kass C.K. Riesbeck Inside Case-Based Explanation 1994 LEA Hillsdale, NJ 207 261
193. A. Ram, and M.T. Cox Introspective reasoning using meta-explanations for multistrategy learning R.S. Michalski G. Tecuci Machine Learning: A Multistrategy Approach IV 1994 Morgan Kaufmann San Mateo, CA 349 377
194. A. Ram, and D. Leake Learning, goals, and learning goals A. Ram D. Leake Goal-Driven Learning 1995 MIT Press/Bradford Books Cambridge, MA 1 37
195. M. Recker, and P. Pirolli Modeling individual differences in student's learning J. Learning Sci. 4 1 1995 1 38
196. L.M. Reder, and F. Ritter What determines initial feeling of knowing? Familiarity with question terms, not with the answer J. Experimental Psychology 18 3 1992 435 451
197. L.M. Reder, and C.D. Schunn Metacognition does not imply awareness: Strategy choice is governed by implicit learning and memory L. Reder Implicit Memory and Metacognition 1996 LEA Mahwah, NJ 45 77
198. J.R. Rice The algorithm selection problem Advances in Computers 15 1976 65 118
199. P. Robertson Confidence from self knowledge and domain knowledge Self-Adaptive Software: Applications Lecture Notes in Comput. Sci. vol. 2614 2003 Springer Berlin
200. P.S. Rosenbloom, J.E. Laird, and A. Newell Metalevels in SOAR P. Maes D. Nardi Meta-Level Architectures and Reflection 1989 North-Holland Amsterdam 227 240
201. P.S. Rosenbloom J.E. Laird A. Newell The Soar Papers: Research on Integrated Intelligence 1993 MIT Press Cambridge, MA
202. S.J. Russell Rationality and intelligence Artificial Intelligence 94 1997 57 77
203. S.J. Russell Metareasoning R.A. Wilson F.C. Keil The MIT Encyclopedia of the Cognitive Sciences (MITECS) 1999 Bradford Books/MIT Press Cambridge Also available at http://cognet.mit.edu/
204. S.J. Russell, and D. Subramanian Provably bounded-optimal agents J. Artificial Intelligence Res. 2 1995 575 609
205. S.J. Russell, and E. Wefald Do the Right Thing: Studies in Limited Rationality 1991 MIT Press Cambridge, MA
206. S.J. Russell, and E. Wefald Principles of metareasoning Artificial Intelligence 49 1991 361 395
207. R.C. Schank, N. Goldman, C. Rieger, C.K. Riesbeck, Primitive concepts underlying verbs of thought, Stanford Artificial Intelligence Project Memo No. 162, Stanford University, Computer Science Department, Stanford, CA, 1972, NTIS No. AD744634
208. R.C. Schank, A. Kass, and C.K. Riesbeck Inside Case-Based Explanation 1994 LEA Hillsdale, NJ
209. W. Schneider Developmental trends in the metamemory-memory behavior relationship: An integrative review D.L. Forrest-Pressley G.E. MacKinnon T.G. Waller Metacognition, Cognition and Human Performance, vol. 1, Theoretical Perspectives 2005 Academic Press New York 57 109
210. L.K. Schubert Some KR&R requirements for self-awareness M. Anderson T. Oates Metacognition in Computation: Papers from 2005 AAAI Spring Symposium 2005 AAAI Press Menlo Park, CA 106 113 Technical Report SS-05-04
211. M. Schut, M. Wooldridge, Principles of intention reconsideration, in: Proceedings of the 5th International Conference on Autonomous Agents, Montreal, Quebec, Canada, 2001, pp. 340-347
212. M.C. Schut, M.J. Wooldridge, and S.D. Parsons The theory and practice of intention reconsideration J. Experiment. Theoret. Artificial Intelligence 6 4 2004 261 293
213. P.J. Schwanenflugel, W.V. Fabricius, C.R. Noyes, K.D. Bigler, and J.M. Alexander The organization of mental verbs and folk theories of knowing J. Memory and Language 33 1994 376 395
214. H.A. Simon A behavioral model of rational choice Quarterly J. Econom. 69 1955 99 118
215. H.A. Simon Models of Bounded Rationality: Behavioral Economics and Business Organization, vol. 2 1982 MIT Press Cambridge, MA
216. P. Singh, EM-ONE: An architecture for reflective commonsense thinking, Ph.D. Dissertation, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Boston, MA, 2005
217. B.F. Skinner Are theories of learning necessary? Psychological Rev. 57 1950 193 216
218. B.F. Skinner What is psychotic behavior? F. Gildea Theory and Treatment of the Psychoses: Some Newer Aspects 1956 Washington University Press St. Louis
219. A. Sloman Beyond shallow models of emotion Cognitive Processing 1 1 2001
220. B.C. Smith Prologue to Reflection and semantics in a procedural language R.J. Brachman H.J. Levesque Readings in Knowledge Representation 1985 Morgan Kaufmann San Mateo, CA 31 40 Original work published 1982
221. G. Stein, and J.A. Barnden Towards more flexible and common-sensical reasoning about beliefs M.T. Cox M. Freed Proceedings of the 1995 AAAI Spring Symposium on Representing Mental States and Mechanisms 1995 AAAI Press Menlo Park, CA 127 135 Available as Technical Report SS-95-08
222. E. Stroulia, Failure-driven learning as model-based self-redesign, Ph.D. Dissertation, College of Computing, Georgia Institute of Technology, Atlanta, 1994
223. E. Stroulia, and A.K. Goel Functional representation and reasoning in reflective systems Applied Intelligence 9 1 1995 101 124 special issue on Functional Reasoning
224. G.J. Sussman A Computer Model of Skill Acquisition 1975 American Elsevier New York
225. H.L. Swanson Influence of metacognitive knowledge and aptitude on problem solving J. Educational Psychol. 82 2 1990 306 314
226. J. Tash, and S. Russell Control strategies for a stochastic planner Proceedings of the Twelfth National Conference on Artificial Intelligence, II 1994 MIT Press Cambridge, MA 1079 1085
227. E.B. Titchener The schema of introspection Amer. J. Psychol. 23 4 1912 485 508
228. K. VanLehn, W. Ball, and B. Kowalski Explanation-based learning of correctness: Towards a model of the self-explanation effect Proceedings of the 12th Annual Conference of the Cognitive Science Society 1990 LEA Hillsdale, NJ
229. K. VanLehn, R.M. Jones, and M.T.H. Chi A model of the self-explanation effect J. Learning Sci. 2 1 1992 1 60
230. M. Veloso, and J.G. Carbonell Case-based reasoning in PRODIGY R.S. Michalski G. Tecuci Machine Learning IV: A Multistrategy Approach 1994 Morgan Kaufmann San Francisco, CA 523 548
231. M. Veloso, J.G. Carbonell, A. Perez, E. Borrajo, D. Fink, and J. Blythe Integrating planning and learning: The PRODIGY architecture J. Theoret. Experiment. Artificial Intelligence 7 1 1995 81 120
232. J. Von Neumann, and O. Morgenstern Theory of Games and Economic Behavior 1944 John Wiley and Sons New York
233. J.B. Watson Psychology from the Standpoint of the Behaviorist 1919 J.B. Lippincott Philadelphia, PA
234. H.M. Wellman Metamemory revisited M.T.H. Chi Contributions to Human Development, vol. 9, Trends in memory development research 1983 S. Karger, AG Basel, Switzerland
235. H.M. Wellman The origins of metacognition D.L. Forrest-Pressley G.E. MacKinnon T.G. Waller Metacognition, Cognition and Human Performance, vol. 1, Theoretical Perspectives 1985 Academic Press New York 1 31
236. H.M. Wellman The Child's Theory of Mind 1992 MIT Press Cambridge, MA
237. T.D. Wilson, and J.W. Schooler Thinking too much: Introspection can reduce the quality of preferences and decisions J. Personality Social Psychol. 60 2 1991 181 192
238. S.R. Yussen The Growth of Reflection in Children 1985 Academic Press New York
239. Z. Zhang, and Q. Yang Feature weight maintenance in case bases using introspective learning J. Intelligent Inform. Syst. 16 2001 95 116
240. S. Zilberstein, Operational rationality through compilation of anytime algorithms, Ph.D. Dissertation, University of California at Berkeley, 1993
241. S. Zilberstein, and S.J. Russell Optimal composition of real-time systems Artificial Intelligence 82 1-2 1996 181 213