Controlled vs. Automatic Processing: A Graph-Theoretic Approach to the Analysis of Serial vs. Parallel Processing in Neural Network Architectures

Proceedings of the 38th Annual Meeting of the Cognitive Science Society, CogSci 2016

Volumn , Issue , 2016, Pages 1547-1552

  Musslick, Sebastian ^a   Dey, Biswadip ^b   Özcimder, Kayhan ^a,b   Patwary, Md Mostofa Ali ^c   Willke, Theodore L ^c   Cohen, Jonathan D ^a  

^a PRINCETON UNIVERSITY   (United States)

^b Princeton University   (United States)

^c INTEL CORPORATION   (United States)

Author keywords

capacity constraint; cognitive control; multitasking

Indexed keywords

GRAPH THEORY; NETWORK ARCHITECTURE; NEURAL NETWORKS; PARALLEL ARCHITECTURES;

AUTOMATIC PROCESSING; CAPACITY CONSTRAINTS; COGNITIVE CONTROL; GRAPH THEORETIC APPROACH; MULTIPLE TASKS; NEURAL NETWORK ARCHITECTURE; PARALLEL PROCESSING; PROCESSING CAPABILITY; SALIENT FEATURES; SHARED REPRESENTATIONS;

MULTITASKING;

EID: 85105967921     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Allport, D. A. (1980). Attention and performance. Cognitive psychology: New directions, 1, 12-153.
2. Anderson, J. R. (2013). The architecture of cognition. Psychology Press.
3. Bengio, Y., Courville, A., & Vincent, P. (2013). Representation learning: A review and new perspectives. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(8), 1798-1828.
4. Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological review, 108(3), 624.
5. Caruana, R. (1997). Multitask learning. Machine learning, 28(1), 41-75.
6. Cohen, J. D., Dunbar, K., & McClelland, J. L. (1990). On the control of automatic processes: a parallel distributed processing account of the stroop effect. Psychological review, 97(3), 332.
7. Cohen, J. D., Servan-Schreiber, D., & McClelland, J. L. (1992). A parallel distributed processing approach to automaticity. The American journal of psychology, 239-269.
8. David E. Rumelhart, G. E. H., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323, 533-536.
9. Feng, S. F., Schwemmer, M., Gershman, S. J., & Cohen, J. D. (2014). Multitasking vs. Multiplexing: Toward a normative account of limitations in the simultaneous execution of control-demanding behaviors. Cognitive, Affective, & Behavioral Neuroscience, 14(1), 129-146.
10. Kiesel, A., Steinhauser, M., Wendt, M., Falkenstein, M., Jost, K., Philipp, A. M., & Koch, I. (2010). Control and interference in task switchinga review. Psychological bulletin, 136(5), 849.
11. Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013). An opportunity cost model of subjective effort and task performance. The Behavioral and brain sciences, 36(6), 661-679.
12. Lieder, F., & Griffiths, T. L. (2015). When to use which heuristic: A rational solution to the strategy selection problem. In 37th cognitive science society conference, tx.
13. Meyer, D. E., & Kieras, D. E. (1997). A computational theory of executive cognitive processes and multiple-task performance: Part i. basic mechanisms. Psychological review, 104(1), 3.
14. Navon, D., & Gopher, D. (1979). On the economy of the human-processing system. Psychological review, 86(3), 214.
15. Posner, M., & Snyder, C. (1975). attention and cognitive control, . In Information processing and cognition: The loyola symposium (pp. 55-85).
16. Salvucci, D. D., & Taatgen, N. A. (2008). Threaded cognition: an integrated theory of concurrent multitasking. Psychological review, 115(1), 101.
17. Saxe, A. M., McClelland, J. L., & Ganguli, S. (2013). Learning hierarchical category structure in deep neural networks. In Proceedings of the 35th annual meeting of the cognitive science society (pp. 1271-1276).
18. Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013). The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron, 79(2), 217-240.
19. Shiffrin, R. M., & Schneider, W. (1977). Controlled and automatic human information processing: Ii. perceptual learning, automatic attending and a general theory. Psychological review, 84(2), 127.
20. Tarjan, R. E., & Trojanowski, A. E. (1977). Finding a Maximum Independent Set. SIAM Journal on Computing, 6(3), 537-546. doi: 10.1137/0206038
21. Yeung, N., Nystrom, L. E., Aronson, J. A., & Cohen, J. D. (2006). Between-task competition and cognitive control in task switching. The Journal of Neuroscience, 26(5), 1429-1438.