Prediction and control in a dynamic environment

Frontiers in Psychology

Volumn 3, Issue MAR, 2012, Pages

  Osman, Magda ^a,b   Speekenbrink, Maarten ^b  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Control; Decision making; Dynamic; Learning; Prediction

Indexed keywords

EID: 84867131516     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00068     Document Type: Article

References (68)

1. Bandura, A., and Locke, E. A. (2003). Negative self-efficacy and goal effects revisited. J. Appl. Psychol. 88, 87-99.
2. Berry, D. (1991). The role of action in implicit learning. Q. J. Exp. Psychol. 43, 881-906.
3. Berry, D., and Broadbent, D. E. (1984). On the relationship between task performance and associated verbalizable knowledge. Q. J. Exp. Psychol. 36, 209-231.
4. Berry, D., and Broadbent, D. E. (1987). The combination of implicit and explicit knowledge in task control. Psychol. Res. 49, 7-15.
5. Berry, D. C., and Broadbent, D. E. (1988). Interactive tasks and the implicit-explicit distinction. Br. J. Psychol. 79, 251-272.
6. Björkman, M. (1971). Policy formation as a function of feedback in a non-metric CPL-task. Umeå Psychol. Reports, 49.
7. Brehmer, B. (1992). Dynamic decision making: human control of complex systems. Acta Psychol. (Amst.) 81, 211-241.
8. Broadbent, D. E. (1977). Levels, hierarchies and the locus of control. Q. J. Exp. Psychol. 32, 109-118.
9. Brown, S., and Steyvers, M. (2005). The dynamics of experimentally induced criterion shifts. J. Exp. Psychol. Learn. Mem. Cogn. 31, 587-599.
10. Bryson, A. E., and Ho, Y. C. (1975). Applied Optimal Control.NewYork: Wiley.
11. Buchner, A. (1995). "Basic topics and approaches to the study of complex problem solving," in Complex Problem Solving: The European Perspective, eds P. A. Frensch and J. Funke (Hillsdale: Lawrence Erlbaum), 27-63.
12. Burns, B. D., and Vollmeyer, R. (2002). Goal specificity effects on hypothesis testing in problem solving. Q. J. Exp. Psychol. 55, 241-261.
13. Castellan, N. J. Jr. (1973). Multiple-cue probability learning with irrelevant cues. Organ. Behav. Hum. Perform. 9, 16-29.
14. Castellan, N. J. Jr., and Edgell, S. E. (1973). An hypothesis generation model for judgment in non-metric multiple-cue probability learning. J. Math. Psychol. 10, 204-222.
15. Cohen, M. S., Freeman, J. T., and Wolf, S. (1996). Meta-cognition in time stressed decision making: recognizing, critiquing and correcting. Hum. Factors 38, 206-219.
16. Dayan, P., and Daw, N. (2008). Connections between computational and neurobiological perspectives on decision making. Cogn.Affect. Behav. Neurosci. 4, 429-453.
17. Dienes, Z., and Fahey, R. (1995). Role of specific instances in controlling.
18. Dienes, Z., and Fahey, R. (1998). The role of implicit memory in controlling a dynamic system. Q. J. Exp. Psychol. 51, 593-614.
19. Dörner, D. (1975). Wie menschen eine welt verbessern wollten und sie dabei zerstörten [How people wanted to improve the world]. Bild Wiss. 12, 48-53.
20. Edgell, S. E. (1974). Configural Information Processing in Decision Making. Indiana Mathematical Psychology Program, Report No. 74-4.
21. Enkvist, T., Newell, B., Juslin, P., and Olsson, H. (2006). On the role of causal intervention in multiple-cue judgment: positive and negative effects on learning. J. Exp. Psychol. Learn. Mem. Cogn. 32, 163-179.
22. Funke, J. (1992). Dealing with dynamic systems: research strategy, diagnostic approach and experimental results. German J. Psychol. 16, 24-43.
23. Funke, J. (1993). "Microworlds based on linear equation systems: a new approach to complex problem solving and experimental results," in The Cognitive Psychology of Knowledge, eds G. Strube and K.-F. Wender (Amsterdam: Elsevier), 313-330.
24. Funke, J., and Müller, H. (1988). Eingreifen und prognostizieren als determinanten von systemidentifikation und systemsteuerung [Intervention and prediction as determinants of system identfication and system control]. Sprache Kogn. 7, 176-186.
25. Gibson, F., Fichman, M., and Plaut, D. C. (1997). Learning in dynamic decision tasks: computational model and empirical evidence. Organ. Behav. Hum. Perform. 71, 1-35.
26. Gibson, F. P. (2007). Learning and transfer in dynamic decision environments. Comput. Math. Organ. Theory 13, 39-61.
27. Gläscher, J., Daw, N., Dayan, P, and O'Doherty, J. P. (2010). States versus rewards: dissociable neural prediction error signals underlying modelbased and model-free reinforcement learning. Neuron 66, 585-595.
28. Gonzales, C., Lerch, J. F., and Lebiere, C. (2003). Instance-based learning in dynamic decision making. Cogn. Sci. 27, 591-635.
29. Goode, N., and Beckmann, J. (2010). You need to know: there is a causal relationship between structural knowledge and control performance in complex problem solving tasks. Intelligence 38, 345-352.
30. Hagmayer, Y, Meder, B, Osman, M., Mangold, S., and Lagnado, D. (2010). Spontaneous causal learning while controlling a dynamic system. Open Psychol. J. 3, 145-162.
31. Hammond, K. R., Summers, D. A., and Deane, D. H. (1973). Negative effects of outcome feedback in multiple-cue probability learning. Organ. Behav. Hum. Perform. 9, 30-34.
32. Holzworth, R. J., and Doherty, M. E. (1976). Feedback effects in a metric multiple-cue probability learning task. Bull. Psychon. Soc. 8, 1-3.
33. Klein, G. (1997). Developing expertise in decision making. Think. Reason. 3, 337-352.
34. Knowlton, B. J., Mangels, J. A., and Squire, L. R. (1996). A neostriatal habit learning system in humans. Science 273, 1399-1402.
35. Knowlton, B. J., Squires, L. R., and Gluck, M. A. (1994). Probabilistic category learning in amnesia. Learn. Mem. 1, 106-120.
36. Körding, K., and Wolpert, D. (2006). Bayesian decision theory in sensorimotor control. Trends Cogn. Sci. 7, 319-326.
37. Lagnado, D., and Sloman, S. A. (2004). The advantage of timely intervention. J. Exp. Psychol. Learn. Mem. Cogn. 30, 856-876.
38. Lee, Y. (1995). Effects of learning contexts on implicit and explicit learning. Mem. Cogn. 23, 723-734.
39. Leigh, J. R. (1992). Control Theory a Guided Tour.London:PeterPeregrinus.
40. Lipshitz, R., Klein, G., Orasanu, J., and Salas, E. (2001). Taking stock of naturalistic decision making. J. Behav. Decis. Mak. 14, 332-351.
41. Lurie, N. H., and Swaminathan, J. M. (2009). Is timely information always better? The effect of feedback frequency on decision making. Organ. Behav. Hum. Decis. Process 108, 315-329.
42. Meder, B., Hagmayer, Y., and Waldmann, M. R. (2008). Inferring interventional predictions from observational learning data. Psychon. Bull. Rev. 15, 75-80.
43. Muchinsky, P. M., and Dudycha, A. L. (1975). Human inference behavior in abstract and meaningful environments. Organ. Behav. Hum. Perform. 13, 377-391.
44. Osman, M. (2008a). Evidence for positive transfer and negative transfer/anti-learning of problem solving skills. J. Exp. Psychol. Gen. 137, 97-115.
45. Osman, M. (2008b). Observation can beaseffectiveasactioninproblem solving. Cogn. Sci. 32, 162-183.
46. Osman, M. (2008c). Seeing is as good as doing. J. Problem Solving 2, 1.
47. Osman, M. (2010a). Controlling uncertainty: a review of human behavior in complex dynamic environments. Psychol. Bull. 136, 65-86.
48. Osman, M. (2010b). Controlling Uncertainty: Decision Making and Learning in Complex Worlds. Oxford: Wiley-Blackwell.
49. Osman, M. (2011). "Monitoring, control and the illusion of control," in Self Regulation, eds M. Fitzgerald and T. Jane, Nova Publishers.
50. Osman, M., and Speekenbrink, M. (2011). Information sampling and strategy development in complex dynamic control environments. Cogn. Syst. Res. 355-364.
51. Osman, M., Wilkinson, L., Beigi, M., Parvez, C., and Jahanshahi, M. (2008). The striatum and learning to control a complex system? Neuropsychologia 46, 2355-2363.
52. Pearl, J. (2000). Causality: Models, Rea-soning, and Inference.NewYork: Cambridge University Press.
53. Poldrack, R., Clark, J., Paré-Blagoev, E. J., Shahomy, D., Creso Moyano, J., Myers, C., and Gluck, M. (2001). Interactive memory systems in the human memory. Nature 414, 546-550.
54. Price, A. (2009). Distinguishing the contributions of implicit and explicit processes to performance on the weather prediction task. Mem. Cogn. 37, 210-222.
55. Rothstein, H. G. (1986). The effects of time pressure on judgment in multiple cue probability learning. Organ. Behav. Hum. Decis. Process 37, 83-92.
56. Sanderson, P. M. (1989). Verbalizable knowledge and skilled task performance: association, dissociation, and mental models. J. Exp. Psychol. Learn. Mem. Cogn. 15, 729-747.
57. Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Annu.Rev.Psychol.57, 87-115.
58. Schultz, W., Dayan, P., and Montague, R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
59. Slovic, P., Rorer, L. G., and Hoffman, P. J. (1971). Analyzing use of diagnostic signs. Invest. Radiol. 6, 18-26.
60. Speekenbrink, M., Channon, S., and Shanks, D. R. (2008). Learning strategies in amnesia. Neurosci. Biobehav. Rev. 32, 292-310.
61. Speekenbrink, M., and Shanks, D. R. (2010). Learning in a changing environment. J. Exp. Psychol. Gen. 139, 266-298.
62. Spirtes, P., Glymour, C., and Scheines, P. (1993). Causation, Prediction, and Search. New York: Springer Verlag.
63. Steyvers, M., Tenenbaum, J. B., Wagenmakers, E. J., and Blum, B. (2003). Inferring causal networks from observations and interventions. Cogn. Sci. 27, 453-489.
64. Sun, R., Merrill, E., and Peterson, T. (2001). From implicit skills to explicit knowledge: a bottom-up model of skill learning. Cogn. Sci. 25, 203-244.
65. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning. Cambridge: MIT press.
66. Vancouver, J. B., and Putka, D. J. (2000). Analyzing goal-striving processes and a test of the generalizability of perceptual control theory. Organ. Behav. Hum. Decis. Process 82, 334-362.
67. Vlek, C. A. J., and van der Heijden, L. H. C. (1970). Aspects of suboptimality in a mutidimensional probabilistic information processing task. Acta Psychol. 34, 300-310.
68. Vollmeyer, R., Burns, B. D., and Holyoak, K. J. (1996). The impact of goal specificity and systematicity of strategies on the acquisition of problem structure. Cogn. Sci. 20, 75-100.