The case for the development and use of "ecologically valid" measures of executive function in experimental and clinical neuropsychology

Journal of the International Neuropsychological Society

Volumn 12, Issue 2, 2006, Pages 194-209

  Burgess, Paul W ^a,b   Alderman, Nick ^c   Forbes, Catrin ^a,b   Costello, Angela ^e   Coates, Laure M A ^e   Dawson, Deirdre R ^d,f   Anderson, Nicole D ^d,f   Gilbert, Sam J ^a,b   Dumontheil, Iroise ^a,b   Channon, Shelley ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c ST ANDREW S HOSPITAL   (United Kingdom)

^d Kunin Lunenfeld Applied Research Unit and Department of Food and Nutrition Services and Baycrest Centre for Geriatric Care   (Canada)

^e KING'S COLLEGE LONDON   (United Kingdom)

^f UNIVERSITY OF TORONTO   (Canada)

Author keywords

Assessment; Frontal lobes; Multiple errands test; Six element test; Stroop; Wisconsin card sorting test

Indexed keywords

ARTICLE; BEHAVIOR CHANGE; BRAIN FUNCTION; COGNITION; DAILY LIFE ACTIVITY; EXPERIMENTATION; HUMAN; MENTAL TEST; NEUROPSYCHOLOGY; NEUROSCIENCE; PRIORITY JOURNAL; PSYCHOMETRY; TASK PERFORMANCE; THEORY; WISCONSIN CARD SORTING TEST;

COGNITION DISORDERS; FRONTAL LOBE; HUMANS; NEUROPSYCHOLOGICAL TESTS; NEUROPSYCHOLOGY;

EID: 33645079918     PISSN: 13556177     EISSN: 14697661     Source Type: Journal    
DOI: 10.1017/S1355617706060310     Document Type: Article

References (164)

1. Ackerly, S.S. & Benton, A.L. (1947). Report of a case of bilateral frontal lobe defect. Research Publications: Association for Research in Nervous and Mental Disease, 27, 479-504.
2. Alderman, N., Burgess, P.W., Knight, C., & Henman, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. Journal of the International Neuropsychological Society, 9, 31-44.
3. Alderman, N., Evans, J.J., Emslie, H., Wilson, B.W., & Burgess, P.W. (1996). Zoo Map Test. In B.A. Wilson, N. Alderman, P.W. Burgess, H. Emslie, & J.J. Evans (Eds.), Behavioural assessment of the dysexecutive syndrome. Bury St. Edmunds: Thames Valley Test Company.
4. Anderson, C.V., Bigler, E.D., & Blatter, D.D. (1995). Frontal lobe lesions, diffuse damage, and neuropsychological functioning in traumatic brain-injured patients. Journal of Clinical and Experimental Neuropsychology, 17, 900-908.
5. Baddeley, A.D. (1996). Exploring the central executive. Quarterly Journal of Experimental Psychology, 49A(1), 5-28.
6. Baddeley, A., Della Salla, S., Gray, C., Papagno, C., & Spinnler, H. (1997). Testing central executive functioning with a pencil-and-paper test. In P. Rabbitt (Ed.), Methodology of frontal and executive function (pp. 61-80). Hove, U.K.: Psychology Press.
7. Benton, A.L. (1991). The prefrontal region: Its early history. In H.S. Levin, H.M. Eisenberg, & A.L. Benton (Eds.), Frontal lobe function and dysfunction (pp. 3-34). New York: Oxford University Press.
8. Bergner, M., Bobbitt, R.A., Carter, W.B., & Gilson, B.S. (1981). The Sickness Impact Profile: Development and final revision of a health status measure. Medical Care, 19, 787-805.
9. Bird, C.M., Castelli, F., Malik, O., Frith, U., & Husain, M. (2004). The impact of extensive medial frontal lobe damage on "Theory of Mind" and cognition. Brain, 127, 914-928.
10. Brickner, R.M. (1936). The intellectual functions of the frontal lobes: A study based upon observation of a man after partial bilateral frontal lobectomy. New York: Macmillan.
11. Bruce, V. & Young, A.W. (1986). Understanding face recognition. British Journal of Psychology, 77, 305-327.
12. Brunswik, E. (1956). Perception and the representative design of psychological experiments (2nd ed.). Berkeley: University of California Press.
13. Burgess, P.W. (1997). Theory and methodology in executive function research. In P. Rabbitt (Ed.), Methodology of frontal and executive function (pp. 81-116). Hove, U.K.: Taylor and Francis.
14. Burgess, P.W. (2000a). Real-world multitasking from a cognitive neuroscience perspective. In S. Monsell & J. Driver (Eds.), Control of cognitive processes: Attention and performance XVIII (pp. 465-472). Cambridge, MA: MIT Press.
15. Burgess, P.W. (2000b). Strategy application disorder: The role of the frontal lobes in human multitasking. Psychological Research, 63, 279-288.
16. Burgess, P.W. & Alderman, N. (2004). Executive dysfunction. In L.H. Goldstein & J.E. McNeil (Eds.), Clinical neuropsychology: A practical guide to assessment and management for clinicians (pp. 185-210). Chichester, U.K.: John Wiley.
17. Burgess, P.W., Alderman, N., Emslie, H., Evans, J.J., & Wilson, B.A. (1996a). The dysexecutive questionnaire. In B.A. Wilson, N. Alderman, P.W. Burgess, H. Emslie, & J.J. Evans (Eds.), Behavioural assessment of the dysexecutive syndrome. Bury St. Edmunds, U.K.: Thames Valley Test Company.
18. Burgess, P.W., Alderman, N., Emslie, H., Evans, J.J., Wilson, B.A., & Shallice, T. (1996b). The simplified six element test. In B.A. Wilson, N. Alderman, P.W. Burgess, H. Emslie, & J.J. Evans (Eds.), Behavioural assessment of the dysexecutive syndrome. Bury St. Edmunds, U.K.: Thames Valley Test Company.
19. Burgess, P.W., Alderman, N., Evans, J., Emslie, H., & Wilson, B.A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4, 547-558.
20. Burgess, P.W., Gilbert, S.J., Okuda, J., & Simons, J.S. (2006). Rostral prefrontal brain regions (Area 10): A gateway between inner thought and the external world? In W. Prinz & N. Sebanz (Eds.), Disorders of volition (pp. 373-396). Cambridge, MA: MIT Press.
21. Burgess, P.W., Quayle, A., & Frith, C.D. (2001). Brain regions involved in propsective memory as determined by positron emission tomography. Neuropsychologia, 39, 545-555.
22. Burgess, P.W. & Robertson, I.H. (2002). Principles of the rehabilitation of frontal lobe function. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 557-572). New York: Oxford University Press.
23. Burgess, P.W., Scott, S.K., & Frith, C.D. (2003). The role of the rostral frontal cortex (area 10) in prospective memory: A lateral versus medial dissociation. Neuropsychologia, 41, 906-918.
24. Burgess, P.W. & Shallice, T. (1996). Response suppression, initiation and strategy use following frontal lobe lesions. Neuropsychologia, 34, 263-273.
25. Burgess, P.W., Simons, J.S., Coates, L.M.-A., & Channon, S. (2005a). The search for specific planning processes. In G. Ward & R. Morris (Eds.), The cognitive psychology of planning (pp. 199-227). Hove, U.K.: Psychology Press.
26. Burgess, P.W., Simons, J.S., Dumontheil, I., & Gilbert, S.J. (2005b). The gateway hypothesis of rostral PFC function. In J. Duncan, P. McLeod, & L. Phillips (Eds.), Measuring the mind: Speed, control, & age (pp. 215-246). Oxford University Press.
27. Burgess, P.W., Veitch, E., Costello, A., & Shallice, T. (2000). The cognitive and neuroanatomical correlates of multitasking. Neuropsychologia, 38, 848-863.
28. Carlin, D., Bonerba, J., Phipps, M., Alexander, G., Shapiro, M., & Grafman, J. (2000). Planning impairments in frontal lobe dementia and frontal lobe lesion patients. Neuropsychologia, 38(5), 655-65.
29. Channon, S. & Green, P.S.S. (1999). Executive function in depression: The role of performance strategies in aiding depressed and non-depressed participants. Journal of Neurology, Neurosurgery and Psychiatry, 66, 162-171.
30. Channon, S., Pellijeff, A., & Rule, A. (2005). Social cognition after head injury: Sarcasm and theory of mind. Brain and Language, 93, 123-134.
31. Chaytor, N. & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13, 181-197.
32. Chorover, S.L. & Cole, M. (1966). Delayed alternation performance in patients with cerebral lesions. Neuropsychologia, 4, 1-7.
33. Clark, A. (1997). Being there: Putting brain, body and world together again. Cambridge, MA: MIT Press.
34. Clark, C., Prior, M., & Kinsella, G.J. (2000). Do executive function deficits differentiate between adolescents with ADHD and Oppositional Defiant/Conduct Disorder? A neuropsychological study using the Six Elements Test and Hayling Sentence Completion Test. Journal of Abnormal Child Psychology, 28, 403-414.
35. Cohen, L.D., Braver, T.S., & O'Reilly, R.C. (1998). A computational approach to prefrontal cortex, cognitive control, and schizophrenia: Recent developments and current challenges. In A.C. Roberts, T.W. Robbins, & L. Weiskrantz (Eds.), The prefrontal cortex: Executive and cognitive functions (pp. 195-220). Oxford: Oxford University Press.
36. Cohen, J.D., Dunbar, K., & McClelland, J.L. (1990). On the control of automatic processes: A parallel distributed processing account of the Stroop effect. Psychological Review, 97, 332-61.
37. Cohen, J.D. & Servan-Schreiber, D. (1992). Context, cortex and doapmine: A connectionist approach to behaviour and biology in schizophrenia. Psychological Review, 99, 45-77.
38. Coltheart, M. & Davies, M. (2003). Inference and explanation in cognitive neuropsychology. Cortex, 39, 188-91.
39. Corcoran, R. & Upton, D. (1993). A role for the hippocampus in card sorting? Cortex, 29, 293-304.
40. Coughlan, A.K., Crowe, S.F., Mahony, K., & Jackson, M. (2004). Predicting competency in automated machine use in an acquired brain injury population using neuropsychological measures. Archives of Clinical Neuropsychology, 19, 673-691.
41. Coughlan, A.K. & Hollows, S.K. (1985). The adult memory and information processing battery (AMIPB). St. James's University Hospital, Leeds, U.K.
42. Dawson, D.R., Anderson, N., Burgess, P.W., Levine, B., Rewilak, D., Cooper, E.K., Farrow, S., Koscik, K.M., Krpan, K.M., Lo, A., Peer, M., & Stuss, D.T. (2005a). The ecological validity of the Multiple Errands Test - Hospital Version: Preliminary findings. Poster presented at meeting of the International Neuropsychological Society, St. Louis, USA, February.
43. Dawson, D.R., Anderson, N., Burgess, P.W., Levine, B., Rewilak, D., Cooper, E.K., Farrow, S., Krpan, K., Peer, M., & Stuss, D.T. (2005b). Naturalistic assessment of executive function: The Multiple Errands Test. Presentation at the American Congress of Rehabilitation Medicine, Chicago, USA, September (Abstract submitted).
44. Dehaene, S., Kerszberg, M., & Changeux, J.-P. (1998). A neuronal model of a global workspace in effortful cognitive tasks. Proceedings of the National Academy of Science, 95, 14,529-14,534.
45. Duchaine, B.C., Dingle, K., Butterworth, E., & Nakayama, K. (2004). Normal greeble learning in a severe case of developmental prosopagnosia. Neuron, 43, 469-473.
46. Duchaine, B.C., Wendt, T.N., New, J., & Kulomaki, T. (2003). Dissociations of visual recognition in a developmental agnostic: Evidence for separate developmental processes. Neurocase, 9, 380-389.
47. Duncan, J. (2005). Prefrontal cortex and Spearman's g. In J. Duncan, L. Phillips, & P. McLeod (Eds.), Measuring the mind: Speed, control and age (pp. 249-274). Oxford: Oxford University Press.
48. Duncan, J., Burgess, P.W., & Emslie, H. (1995). Fluid intelligence after frontal lobe lesions. Neuropsychologia, 33, 261-268.
49. Duncan, J., Johnson, R., Swales, M., & Freer, C. (1997). Frontal lobe deficits after head injury: Unity and diversity of function. Cognitive Neuropsychology, 14, 713-741.
50. Duncan, J. & Miller, E.K. (2002). Cognitive focus through adaptive neural coding in the primate prefrontal cortex. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 278-291). Oxford: Oxford University Press.
51. Emslie, H., Wilson, F.C., Burden, V., Nimmo-Smith, I., & Wilson, B.A. (2003). Behavioural assessment of the dysexecutive syndrome in children (BADS-C). London, U.K.: Harcourt Assessment.
52. Eslinger, P.J. & Damasio, A.R. (1985). Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient E.V.R. Neurology, 35, 1731-1741.
53. Evans, J.J., Chua, S., McKenna, P.J., & Wilson, B.A. (1997). Assessment of the dysexecutive syndrome in schizophrenia. Psychological Medicine, 27, 635-646.
54. Farias, S.T., Harrell, E., Neumann, C., & Houtz, A. (2003). The relationship between neuropsychological performance and daily functioning in individuals with Alzheimer's disease: Ecological validity of neuropsychological tests. Archives of Clinical Neuropsychology, 18, 655-672.
55. Fisher, A.G. (2003). Assessment of motor and process skills. Vol. 1: Development, standardization, and administration manual (5th ed.). Fort Collins, CO: Three Star Press.
56. Fortin, S., Godbout, L., & Braun, C.M.J. (2003). Cognitive structure of executive deficits in frontally lesioned head trauma patients performing activities of daily living. Cortex, 39, 273-291.
57. Frith, C.D. & Frith, U. (2003). Development and neurophysiology of mentalizing. Philosophical Transactions of the Royal Society of London B, 358(1431), 459-473.
58. Fuster, J.M. (1997). The prefrontal cortex: Anatomy, physiology and neuropsychology of the frontal lobe (3rd ed.). New York: Lippincott-Raven.
59. Fuster, J.M. (2002). Physiology of executive functions: The perception-action cycle. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function, pp. 96-108. Oxford U.K.: Oxford University Press.
60. Garden, S.E., Phillips, L.H., & MacPherson, S.E. (2001). Midlife aging, open-ended planning, and laboratory measures of executive function. Neuropsychology, 15, 472-482.
61. Gelb, A. & Goldstein, K. (1920). Psychologische analysenh hirnpathologischer faelle. Leipzig: Barth.
62. Gilbert, S.J., Frith, C.D., & Burgess, P.W. (2005). Involvement of rostral prefrontal cortex in selection between stimulus-oriented and stimulus-independent thought. European Journal of Neuroscience, 21, 1423-1431.
63. Gilbert, S.J., Simons, J.S., Frith, C.D., & Burgess, P.W. (2006). Performance-related activity in medial rostral prefrontal cortex (Area 10) during low-demand tasks. Journal of Experimental Psychology: Human Perception and Performance, 32, 45-58.
64. Gilbert, S.J., Spengler, S., Simons, J.S., Steele, J.D., Lawrie, S.M., Frith, C.D., & Burgess, P.W. (in press). Functional specialization within rostral prefrontal cortex (area 10): A meta- analysis. Journal of Cognitive Neuroscience.
65. Gioia, G.A. & Isquith, P.K. (2004). Ecological assessment of executive function in traumatic brain injury. Developmental Neuropsychology, 25, 135-158.
66. Goel, V. & Grafman, J. (1995). Are the frontal lobes implicated in "planning" functions? Interpreting data from the Tower of Hanoi. Neuropsychologia, 33, 623-42.
67. Goel, V. & Grafman, J. (2000). The role of the right prefrontal cortex in ill-structured problem solving. Cognitive Neuropsychology, 17, 415-436.
68. Goel, V., Grafman, J., Tajik, J., Gana, S., & Danto, D. (1997). A study of the performance of patients with frontal lesions in a financial planning task. Brain, 120, 1805-1822.
69. Goldman-Rakic, P.S. (1995). Architecture of the prefrontal cortex and the central executive. Annals of the New York Academy of Science, 769, 212-220.
70. Goldman-Rakic, P.S. (1998). The prefrontal landscape: Implications of functional architecture for understanding human mentation and the central executive. In A.C. Roberts, T.W. Robbins, & L. Weiskrantz (Eds.), The prefrontal cortex: Executive and cognitive functions (pp. 87-102). Oxford, U.K.: Oxford University Press.
71. Goldman-Rakic, P.S. & Leung, H.-C. (2002). Functional architecture of the dorsolateral prefrontal cortex in monkeys and humans. In D.T. Stuss & R.T. Knight (Eds.), Principles ofqs frontal lobe function (pp. 85-95). Oxford: Oxford University Press.
72. Goldstein, L.H., Bernard, S., Fenwick, P.B.C., Burgess, P.W., & McNeil, J. (1993). Unilateral frontal lobectomy can produce strategy application disorder. Journal of Neurology, Neurosurgery and Psychiatry, 56, 274-276.
73. Goldstein, K.H. & Scheerer, M. (1941). Abstract and concrete behaviour: An experimental study with special tests. Psychological Monographs, 53 (No. 2) (Whole No. 239).
74. Grady, C.L. (1999). Neuroimaging and activation of the frontal lobes. In B.L. Miller & J.L. Cummings (Eds.), The human frontal lobes: Function and disorders (pp. 196-230). New York: Guilford Press.
75. Grafman, J. (2002). The structured event complex and the human prefrontal cortex. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 292-310). Oxford: Oxford University Press.
76. Grant, D.A. & Berg, E.A. (1948). A behavioural analysis of degree or reinforcement and ease of shifting to new responses in a Weigl-type card sorting problem. Journal of Experimental Psychology, 38, 404-411.
77. Greve, K.W., Brooks, J., Crouch, J.A., Williams, M.C., & Rice, W.J. (1997). Factorial structure of the Wisconsin Card Sorting Test. British Journal of Clinical Psychology, 36, 283-285.
78. Haggard, P. & Richardson, J. (1996). Spatial patterns in the control of human movement. Journal of Experimental Psychology: Human Perception and Performance, 22, 42-62.
79. Hammond, K.R. (1966). The psychology of Egon Brunswik. New York: Holt, Rinehart, & Winston.
80. Hammond, K.R. (1998). Ecological validity: Then and now. Unpublished manuscript available electronically at: http://brunswik.org/notes/ essay2.html
81. Harlow, J.M. (1848). Passage of an iron bar through the head. Boston Medical and Surgical Journal, 39, 389-393.
82. Harlow, J.M. (1868). Recovery from the passage of an iron bar through the head. Reprinted in Miller, E. (1993). History of Psychiatry, 4, 271-278.
83. Higginson, C.I., Arnett, P.A., & Voss, W.D. (2000). The ecological validity of clinical tests of memory and attention in multiple sclerosis. Archives of Clinical Neuropsychology, 15, 185-204.
84. Hoclet, E., Gronier, D., Joly-Pottuz, B., & Carbonnel, S. (2003). The six element test with twenty-four TBI patients during rehabilitation, and fractionation of the Supervisory System. Revue de Neuropsychologie, 13, 263-290.
85. Hodgson, T.L., Bajwa, A., Owen, A.M., & Kennard, C. (2000). The strategic control of gaze direction in the Tower-of-London task. Journal of Cognitive Neuroscience, 12, 894-907.
86. Hutchins, E. (1995). Cognition in the wild. Cambridge, MA: MIT Press.
87. Jacobsen, C.F. (1931). A study of cerebral function in learning: The frontal lobes. Journal of Comparative Neurology, 52, 271-340.
88. Jacobsen, C.F. (1936). Studies of cerebral function in primates: I. The functions of the frontal association areas in monkeys. Comparative Psychology Monographs, 13, 3-60.
89. Jelicic, M., Henquet, C.E., Derix, M.M., & Jolles, J. (2001). Test-retest stability of the behavioural assessment of the dysexecutive syndrome in a sample of psychiatric patients. International Journal of Neuroscience, 110, 73-8.
90. Kafer, K.L. & Hunter, M. (1997). On testing the face validity of planning/problem-solving tasks in a normal population. Journal of the International Neuropsychological Society, 3, 108-19.
91. Kanwisher, N. (2000). Domain-specificity in face perception. Nature Neuroscience, 3, 759-761.
92. Kibby, M.Y., Schmitter-Edgecombe, M., & Long, C.J. (1998). Ecological validity of neuropsychological tests: Focus on the California Verbal Learning Test and the Wisconsin Card Sorting Test. Archives of Clinical Neuropsychology, 13, 523-534.
93. Kingstone, A., Smilek, D., Birmingham, E., Cameron, D., & Bischof, W.F. (2005). Cognitive ethology: Giving real life to attention research. In J. Duncan, L. Phillips, & P. McLeod (Eds.), Measuring the mind: Speed, control and age (pp. 341-357). Oxford: Oxford University Press.
94. Kingstone, A., Smilek, D., & Ristic, J. (2003). Attention, researchers! It is time to take a look at the real world. Current Directions in Psychological Science, 12, 176-180.
95. Kirsh, D. (1995). The intelligent use of space. Artificial Intelligence, 73, 31-68.
96. Kliegel, M., McDaniel, M.A., & Einstein, G.O. (2000). Plan formation, retention, and execution in prospective memory: A new approach and age-related effects. Memory and Cognition, 28, 1041-1049.
97. Knight, C., Alderman, N., & Burgess, P.W. (2002). Development of a simplified version of the multiple errands test for use in hospital settings. Neuropsychological Rehabilitation, 12, 231-255.
98. Kvavilashvili, L. & Ellis, J. (2004). Ecological validity and the real-life/laboratory controversy in memory research: A critical and historical review. History & Philosophy of Psychology, 6, 59-80.
99. Leichnetz, G.R. (1986). Afferent and efferent connections of the dorsolateral precentral areas (area 4, hand/arm region) in the macaque monkey, with comparisons to area 8. Journal of Comparative Neurology, 254, 460-492.
100. Levine, B., Freedman, M., Dawson, D., Black, S.E., & Stuss, D.T. (1999). Ventral frontal contribution to self-regulation: Convergence of episodic memory and inhibition. Neurocase, 5, 263-275. (Special issue on orbitofrontal cortex).
101. Levine, B., Robertson, I., Clare, L., Carter, G., Hong, J., Wilson, B.A., Duncan, J., & Stuss, D.T. (2000). Rehabilitation of executive functioning: An experimental-clinical validation of goal management training. Journal of the International Neuropsychological Society, 6, 299-312.
102. Levine, B., Stuss, D.T., Milberg, WP., Alexander, M.P., Schwartz, M., & Macdonald, R. (1998). The effects of focal and diffuse brain damage on strategy application: Evidence from focal lesions, traumatic brain injury and normal aging. Journal of the International Neuropsychological Society, 4, 247-264.
103. MacSweeney, M., Campbell, R., Woll, B., Giampicto, V., David, A.S., McGuire, P.K., Calvert, G., & Brammer, M.J. (2004). Dissociating linguistic and non-linguistic gestural communication in the brain. NeuroImage, 22, 1605-1618.
104. Malec, J.F. & Lezak, M.D. (2003). Manual for the Mayo-Portland adaptability inventory. PM&R-3MB-SMH, Mayo Medical Center, Rochester, MN 55905, USA.
105. Malmo, R.B. (1948). Psychological aspects of frontal gyrectomy and frontal lobotomy in mental patients. Research Publications of the Association for Research into Nervous and Mental Disease, 27, 537-564.
106. Manchester, D., Priestly, N., & Jackson, H. (2004). The assessment of executive functions: Coming out of the office. Brain Injury, 18, 1067-1081.
107. Manly, T., Hawkins, K., Evans, J., Woldt, K., & Robertson, I.H. (2002). Rehabilitation of executive function: Facilitation of effective goal management on complex tasks using periodic auditory alerts. Neuropsychologia, 40, 271-281.
108. Marenco, S., Coppola, R., Daniel, D.G., Zigun, J.R., & Weinberger, D.R. (1993). Regional cerebral blood flow during the Wisconsin Card Sorting Test in normal subjects studied by xenon-133 dynamic SPECT: Comparison of absolute values, percent distribution values, and covariance analysis. Psychiatry Research, 50, 177-192.
109. McDonald, S., Flanagan, S., Martin, I., & Saunders, C. (2004). The ecological validity of TASIT: A test of social perception. Neuropsychological Rehabilitation, 14, 285-302.
110. Mentzel, H.J., Gaser, C., Volz, H.P., Rzanny, R., Hager, F., Sauer, H., & Kaiser, W.A. (1998). Cognitive stimulation with the Wisconsin Card Sorting Test: Functional MR imaging at 1.5 T. Radiology, 207, 399-404.
111. Miller, E. (1984). Verbal fluency as a measure of verbal intelligence and in relation to different types of cerebral pathology. British Journal of Clinical Psychology, 23, 53-57.
112. Milner, B. (1963). Effects of different brain regions on card sorting. Archives of Neurology (Chicago), 9, 90-100.
113. Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H., Howerter, A., & Wager, T.D. (2000). The unity and diversity of executive functions and their contributions to complex "Frontal Lobe" tasks: A latent variable analysis. Cognitive Psychology, 41, 49-100.
114. Morris, R.G., Miotto, E.C., Feigenbaum, J.D., Bullock, P., & Polkey, C.E. (1997). The effect of goal-subgoal conflict on planning ability after frontal- and temporal-lobe lesions in humans. Neuropsychologia, 35, 1147-57.
115. Nelson, H.E. (1976). A modified card sorting test sensitive to frontal lobe defects. Cortex, 12, 313-324.
116. Nilsson, J.P., Soderstrom, M., Karlsson, A.U., Lekander, M., Akerstedt, T., Lindroth, N.E., & Axelsson, J. (2005). Less effective executive functioning after one night's sleep deprivation. Journal of Sleep Research, 14, 1-6.
117. Norman, D.A. & Shallice, T. (1986). Attention to action: Willed and automatic control of behaviour. In R.J. Davidson, G.E. Schwartz, & D. Shapiro (Eds.), Consciousness and self regulation: Advances in research, (Vol. IV, pp.1-18). New York: Plenum. Reprinted in Cognitive neuroscience: A reader (M.S. Gazzaniga (Ed.), Malden, Mass: Blackwell, 2000. Initially published as a technical report in 1980.
118. Odhuba, R.A., van den Broek, M.D., & Johns, L.C. (2005). Ecological validity of measures of executive functioning. British Journal of Clinical Psychology, 44, 269-278.
119. Okuda, J., Frith, C.D., Burgess, & P.W. (2004). Organisation of time- and event-based intentions in rostral prefrontal cortex. NeuroImage, 22(S1) S53.
120. Owen, A.M., Herrod, N.J., Menon, D.K., Clark, J.C., Downey, S.P., Carpenter, T.A., Minhas, P.S., Turkheimer, F.E., Willimas, E.J., Robbins, T.W., Sahakian, B.J., Petrides, M., & Pickard, J.D. (1999). Redefining the functional organization of working memory processes within human lateral prefrontal cortex. European Journal of Neuroscience, 11, 567-574.
121. Passingham, R. (1993). The frontal lobes and voluntary action. Oxford, U.K.: Oxford University Press.
122. Penfield, W. & Evans, J. (1935). The frontal lobe in man: A clinical study of maximum removals. Brain, 58, 115-133.
123. Perret, E. (1974). The left frontal lobe of man and the suppression of habitual responses in verbal categorical behaviour. Neuropsychologia, 12, 323-330.
124. Petrides, M. (1994). Frontal lobes and working memory: Evidence from investigations of the effects of cortical excisions in nonhuman primates. In F. Boller & J. Grafman (Eds.), Handbook of Neuropsychology, Vol. 9 (pp. 59-82). Amsterdam: Elsevier.
125. Petrides, M. (1998). Specialized systems for the processing of mnemonic information within the primate frontal cortex. In A.C. Roberts, T.W. Robbins, & L. Weiskrantz (Eds.), The prefrontal cortex: Executive and cognitive functions (pp. 103-116). Oxford: Oxford University Press.
126. Petrides, M. & Pandya, D.N. (2002). Association pathways of the prefrontal cortex and functional observations. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 31-50). Oxford: Oxford University Press.
127. Pribram, K.H. (1973). The primate frontal cortex - executive of the brain. In K.H. Pribram & A.R. Luria (Eds.), Psychophysiology of the frontal lobes (pp. 293-314). New York: Academic Press.
128. Ramnani, N. & Owen, A.M. (2004). Anterior prefrontal cortex: Insights into function from anatomy and neuroimaging. Nature Reviews Neuroscience, 5, 184-194.
129. Ramnani, N., Toni, L, Passingham, R.E., & Haggard, P. (2001). The cerebellum and parietal cortex play a specific role in coordination: A PET study. NeuroImage, 14, 899-911.
130. Robertson, I.H., Ward, T., Ridgeway, V., & Nimmo-Smith, I. (1994). Test of everyday attention (TEA). London: Harcourt Assessment.
131. Rowe, J.B., Owen, A.M., Johnsrude, I.S., & Passingham, R.E. (2001). Imaging the mental components of a planning task. Neuropsychologia, 39, 315-327.
132. Semkovska, M., Bedard, M.A., Godbout, L., Limoge, F., & Stip, E. (2004). Assessment of executive function during activities of daily living in schizophrenia. Schizophrenia Research, 69, 289-300.
133. Shallice, T. (1982). Specific impairments of planning. Philosophical Transactions of the Royal Society of London B, 298, 199-209.
134. Shallice, T. (1988). From neuropsychology to mental structure. New York: Cambridge University Press.
135. Shallice, T. (2002). Fractionation of the supervisory system. In D.T. Stuss & R.T. Knight (Eds.), Principles of frontal lobe function (pp. 261-277). New York: Oxford University Press.
136. Shallice, T. & Burgess, P.W. (1991a). Deficits in strategy application following frontal lobe damage in man. Brain, 114, 727-741.
137. Shallice, T. & Burgess, P.W. (1991b). Higher-order cognitive impairments and frontal lobe lesions in man. In H.S. Levin, H.M. Eisenberg, & A.L. Benson, (Eds.), Frontal lobe function and injury (pp. 125-138). Oxford: Oxford University Press.
138. Shallice, T. & Burgess, P.W. (1993). Supervisory control of action and thought selection. In A. Baddeley & L. Weiskrantz (Eds.), Attention: Selection, awareness and control: A tribute to Donald Broadbent (pp. 171-187). Oxford: Clarendon Press.
139. Shallice, T. & Burgess, P.W. (1996). Domains of supervisory control and the temporal organisation of behaviour. Philosophical Transactions of the Royal Society B, 351, 1405-1412.
140. [Reprinted in A.C. Roberts, T.W. Robbins, & L. Weiskrantz (Eds.), The prefrontal cortex: Executive and cognitive functions, pp. 22-35. Oxford, U.K.: Oxford University Press, 1998.]
141. Shallice, T., Burgess, P.W., Schon, F., & Baxter, D.M. (1989). The origins of utilisation behaviour. Brain, 112, 1587-1598.
142. Shallice, T. & Evans, M.E. (1978). The involvement of the frontal lobes in cognitive estimation. Cortex, 14, 294-303.
143. (Reprinted in J. Davidoff (Ed.), Brain and behaviour: Critical concepts in psychology, Vol. 4, London: Routledge.)
144. Simons, J.S., Gilbert, S.J., Owen, A.M., Fletcher, P.C., & Burgess, P.W. (2005a). Distinct roles for lateral and medial anterior prefrontal cortex in contextual recollection. Journal of Neurophysiology, 94, 813-820.
145. Simons, J.S., Owen, A.M., Fletcher, P.C., & Burgess, P.W. (2005b). Anterior prefrontal cortex and the recollection of internally-generated thoughts. Neuropsychologia, 43, 1774-1783.
146. Simons, J.S., Schölvinck, M., Gilbert, S.J., Frith, C.D., & Burgess, P.W. (In press). Differential components of prospective memory? Evidence from fMRI. Neuropsychologia.
147. Stroop, J.R. (1935). Studies of interference in serial verbal reaction. Journal of Experimental Psychology, 18, 643-662.
148. Stuss, D.T., Binns, M.A., Murphey, K.J., & Alexander, M.P. (2002). Dissociations within the anterior attentional system: Effects of task complexity and irrelevant information on reaction time speed and accuracy. Neuropsychology, 16, 500-513.
149. Stuss, D.T., Floden, D., Alexander, M.P., Levine, B., & Katz, D. (2001). Stroop performance in focal lesion patients: Dissociation of processes and frontal lobe lesion location. Neuropsychologia, 39, 771-786.
150. Stuss, D.T., Levine, B., Alexander, M.P., Hong, J., Palumbo, C., Hamer, L., Murphy, K.J., & Izukawa, D. (2000). Wisconsin Card Sorting Test performance in patients with focal frontal and posterior brain damage: Effects of lesion location and test structure on separable cognitive processes. Neuropsychologia, 38, 388-402.
151. Stuss, D.T., Shallice, T., Alexander, M.P., & Picton, T.W. (1995). A multidisciplinary approach to anterior attentional functions. Annals of the New York Academy of Sciences, 769, 191-212.
152. Sukantarat, K.T., Burgess, P.W., Williamson, R.C.N., & Brett, S.J. (2005). Prolonged cognitive dysfunction in survivors of critical illness. Anaesthesia, 60, 847-853.
153. Teuber, H.-L. (1964). The riddle of frontal lobe function in man. In J.M. Warren & K. Akert (Eds.), The frontal granular cortex and behavior (pp. 410-477). New York: McGraw-Hill.
154. van den Broek, M.D., Bradshaw, C.M., & Szabadi, E. (1993). Utility of the Modified Wisconsin Card Sorting Test in neuropsychological assessment. British Journal of Clinical Psychology, 32, 333-343.
155. Ward, L.M. (2002). Dynamical cognitive science. Cambridge, MA: MIT Press.
156. Weinberg, G.M. (1975). An introduction to general systems thinking. New York: Wiley.
157. Weigl, E. (1927). Zur Psychologie sogenannter Abstraktionsprozesse. Zeitschrift fur Psychologie, 103, 2-45.
158. Translated by M. Rioch and reprinted as: On the psychology of so-called processes of abstraction. Journal of Abnormal and Social Psychology, 36, 3-33, 1948].
159. Welsh, M.C., Revilla, V., Strongin, D., & Kepler, M. (2000). Towers of Hanoi and London: Is the nonshared variance due to differences in task administration? Perceptual and Motor Skills, 90, 562-572.
160. Welsh, M.C., Satterlee-Cartmell, T., & Stine, M. (1999). Towers of Hanoi and London: Contribution of working memory and inhibition to performance. Brain and Cognition, 41, 231-234.
161. Wilson, B.A., Alderman, N., Burgess, P.W., Emslie, H., & Evans, J.J. (1996). Behavioural assessment of the dysexecutive syndrome. London: Harcourt Assessment.
162. Wilson, B.A., Cockburn, J., & Baddeley, A. (2003). The River-mead Behavioural Memory Test (RBMT-II). London: Harcourt Assessment.
163. Wilson, B.A., Evans, J.J., Emslie, H., Alderman, N., & Burgess, P.W. (1998). The development of an ecologically valid test for assessing patients with a dysexecutive syndrome. Neuropsychological Rehabilitation, 8, 213-228.
164. Zakzanis, K.K. & Young, D.A. (2001). Memory impairment in abstinent MDMA ("Ecstasy") users: A longitudinal investigation. Neurology, 56, 966-969.