Alternatives to switch-cost scoring in the task-switching paradigm: Their reliability and increased validity

Behavior Research Methods

Volumn 46, Issue 3, 2014, Pages 702-721

  Hughes, Meredith M ^a   Linck, Jared A ^a   Bowles, Anita R ^a   Koeth, Joel T ^a   Bunting, Michael F ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Measurement; Reliability; Scoring method; Switch cost; Task switching; Validity

Indexed keywords

ADULT; ARTICLE; EXECUTIVE FUNCTION; FEMALE; HUMAN; MALE; METHODOLOGY; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REPRODUCIBILITY; STATISTICAL MODEL; TIME; YOUNG ADULT;

ADULT; EXECUTIVE FUNCTION; FEMALE; HUMANS; MALE; MODELS, STATISTICAL; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; TIME FACTORS; YOUNG ADULT;

EID: 84904741488     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-013-0411-5     Document Type: Article

References (51)

1. Altmann, E. M. (2007). Comparing switch costs: Alternating runs and explicit cuing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33(3), 475-483.
2. Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296-322.
3. Bruyer, R., & Brysbaert, M. (2011). Combining speed and accuracy in cognitive psychology: Is the inverse efficiency score (IES) a better dependent variable than the mean reaction time (RT) and the percentage of errors (PE)? Psychologica Belgica, 51(1), 5-13.
4. Bunting, M. F., Bowles, A. R., Campbell, S. G., Linck, J. L., Mislevy, M. A., Jackson, S. R., Doughty, C. J. (2010). Reinventing DLAB: Potential new predictors of success at DLIFLC (CASL Technical Report TTO 82114). College Park, MD: University of Maryland Center for Advanced Study of Language.
5. Crocker, L., & Algina, J. (2006). Introduction to classical & modern test theory. Mason, OH: Thomson Wadsworth.
6. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
7. De Jong, R. (2000). An intention-activation account of residual switch costs. In S. Monsell & J. Driver (Eds.), Attention and performance XVIII (pp. 357-376). Cambridge, MA: MIT Press.
8. Einöther, S. J. L., Martens, V. E. G., Rycroft, J. A., & De Bruin, E. A. (2010). L-Theanine and caffeine improve task switching but not intersensory attention or subjective alertness. Appetite, 54, 406-409.
9. Fagot, C. (1994). Chronometric investigations of task switching. (Doctoral dissertation, University of California, San Diego). Retrieved from http://www. pashler. com/Articles/techreport/Fagot_Dissertation1994. pdf.
10. Fidelman, C., & Kenyon, D. (2009). Final report on measures proposed for a Hi-LAB GDS. Washington, DC: Center for Applied Linguistics.
11. Friedman, N. P., & Miyake, A. (2004). The relations among inhibition and interference control functions: A latent variable analysis. Journal of Experimental Psychology: General, 133, 101-135.
12. Friedman, N. P., Miyake, A., Corley, R. P., Young, S. E., DeFries, J. C., & Hewitt, J. K. (2006). Not all executive functions are related to intelligence. Psychological Science, 17(2), 172-179.
13. Gopher, D., Armony, L., & Greenshpan, Y. (2000). Switching tasks and attention policies. Journal of Experimental Psychology: General, 129, 308-339.
14. Gupta, R., Kar, B. R., & Srinivasan, N. (2009). Development of task switching and post-error-slowing in children. Behavioral and Brain Functions, 5, 38.
15. Hallett, P. E. (1978). Primary and secondary saccades to goals defined by instructions. Vision Research, 18, 1279-1296.
16. Jamadar, S., Michie, P., & Karayanidis, F. (2009). Sequence effects in cued task switching modulate response preparedness and repetition priming processes. Psychophysiology, 47(2), 365-386.
17. Jamadar, S., Michie, P., & Karayanidis, F. (2010). Compensatory mechanisms underlie intact task-switching performance in schizophrenia. Neuropsychologia, 48, 1305-1323.
18. Kiesel, A., Stenhauser, M., Wendt, M., Falkenstein, M., Jost, K., Philipp, A. M., & Koch, I. (2010). Control and interference in task switching - A review. Psychological Bulletin, 136, 849-874.
19. Koch, I., & Allport, A. (2006). Cue-based prepatation and stimulus-based priming of tasks in task switching. Memory & Cognition, 34, 433-444.
20. Lien, M. C., Ruthruff, E., Remington, R. W., & Johnston, J. C. (2005). On the limits of advance preparation for a task switch: Do people prepare all the task some of the time or some of the task all of the time? Journal of Experimental Psychology: Human Perception and Performance, 31(2), 299-315.
21. Linn, R. R., & Slinde, J. A. (1977). The determination of the significance of change between pre- and posttesting periods. Review of Educational Research, 47(1), 121-150.
22. Logan, G. D. (2003). Executive control of thought and action: In search of the wild homunculus. Current Directions in Psychological Science, 12, 45-48.
23. Meier, B., Woodward, T. S., Rey-Mermet, A., & Graf, P. (2009). The bivalency effect in task switching: General and enduring. Canadian Journal of Experimental Psychology, 63(3), 201-210.
24. Meiran, N. (1996). The reconfiguration of processing mode prior to task performance. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 1423-1442.
25. Meiran, N. (2000). Modeling cognitive control in task-switching. Psychological Research, 63, 234-249.
26. Meiran, N., Chorev, Z., & Sapir, A. (2000). Component processes in task switching. Cognitive Psychology, 41, 211-253.
27. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex "frontal lobe" tasks: A latent variable analysis. Cognitive Psychology, 41, 48-100.
28. Monsell, S. (2003). Task switching. Trends in Cognitive Science, 7, 134-140.
29. Monsell, S., Azuma, R., Eimer, M., Le Pelley, M., & Strafford, S. (1998). Does a prepared task switch require an extra (control) process between stimulus onset and response selection? Poster presented at the 18th International Symposium on Attention and Performance. Windsor, England: Great Park.
30. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill, Inc.
31. Pachella, R. G. (1974). The interpretation of reaction time in information processing research. In B. Kantowitz (Ed.), Human information processing (pp. 41-82). Potomac, MD: Lawrence Erlbaum.
32. Poljac, E., Simon, S., Ringlever, L., Kalcik, D., Groen, W. B., Buitelaar, J. K., & Bekkering, H. (2010). Impaired task switching performance in children with dyslexia but not in children with autism. The Quarterly Journal of Experimental Psychology, 63(2), 401-416.
33. Prior, A., & Gollan, T. H. (2011). Good language-switchers are good task-switchers: Evidence from Spanish-English and Mandarin-English bilinguals. Journal of the International Neuropsychological Society, 17, 1-10.
34. Prior, A., & MacWhinney, B. (2010). A bilingual advantage in task switching. Bilingualism: Language and Cognition, 13(2), 253-262.
35. Rabbitt, P. (1997). Introduction: Methodologies and models in the study of executive function. In P. Rabbitt (Ed.), Methodology of frontal and executive function (pp. 1-38). Hove, England: Psychology Press.
36. Rogers, R. D., & Monsell, S. (1995). The cost of a predictable switch between simple cognitive tasks. Journal of Experimental Psychology, 70, 207-231.
37. Rubin, O., & Meiran, N. (2005). On the origins of the task mixing cost in the cuing task-switching paradigm. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(6), 1477-1491.
38. Rubinstein, J. S., Meyer, D. E., & Evans, E. (2001). Executive control of cognitive processes in task switching. Journal of Experimental Psychology: Human Perception and Performance, 27, 763-797.
39. Saeki, E., & Saito, S. (2009). Verbal representation in task order control: An examination with transition and task cues in random task switching. Memory & Cognition, 37(7), 1040-1050.
40. Salthouse, T. A., Fristoe, N., McGurthy, K. E., & Hambrick, D. Z. (1998). Relation of task switching to speed, age, and fluid intelligence. Psychology and Aging, 13, 445-461.
41. Samavatyan, H., & Leth-Steensen, C. (2009). The time course of task switching: A speed-accuracy trade-off analysis. Memory & Cognition, 37(7), 1051-1058.
42. Siemsen, E., Roth, A., & Oliveira, P. (2010). Common method bias in regression models with linear, quadratic, and interaction effects. Organizational Research Methods, 13, 456-476.
43. Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3, 271-295.
44. Townsend, J. T., & Ashby, F. G. (1978). Methods of modeling capacity in simple processing systems. In J. Castellan & F. Restle (Eds.), Cognitive theory (Vol. 3, pp. 200-239). Hillsdale, NJ: Erlbaum.
45. Townsend, J. T., & Ashby, F. G. (1983). Stochastic modeling of elementary psychological processes. Cambridge: Cambridge University Press.
46. Unsworth, N., Schrock, J. C., & Engle, R. W. (2004). Working memory capacity and the antisaccade task: Individual differences in voluntary saccade control. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 1302-1321.
47. Vandierendonck, A., Liefooghe, B., & Verbruggen, F. (2010). Task switching: Interplay of reconfiguration and interface control. Psychological Bulletin, 136(4), 601-626.
48. Was, C. A., & Woltz, D. J. (2007). Reexamining the relationship between working memory and comprehension: The role of available long-term memory. Journal of Memory and Language, 56(1), 86-102.
49. Wickelgren, W. A. (1977). Speed-accuracy tradeoff and information processing dynamics. Acta Psychologia, 41(1), 67-85.
50. Woltz, D. J., & Was, C. A. (2006). Availability of related long-term memory during and after attention focus in working memory. Memory and Cognition, 33(3), 668-684.
51. Zimmerman, D. W., & Williams, R. H. (1982). Gain scores in research can be highly reliable. Journal of Educational Measurement, 19, 149-154.