The discovery of processing stages: Analyzing EEG data with hidden semi-Markov models

NeuroImage

Volumn 108, Issue 1, 2015, Pages 60-73

  Borst, Jelmer P ^a,b   Anderson, John R ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Associative recognition; EEG; Hidden semi Markov models; Processing stages

Indexed keywords

ARTICLE; ASSOCIATIVE RECOGNITION; ASSOCIATIVE RETRIEVAL PROCESS; BEHAVIOR; BRAIN SIGNATURE; COGNITION; DECISION MAKING; ELECTROENCEPHALOGRAM; FAMILIARITY PROCESS; HIDDEN MARKOV MODEL; HIDDEN SEMI MARKOV MODEL; HUMAN; HUMAN EXPERIMENT; HUMAN INFORMATION PROCESSING; LEAVE ONE OUT CROSS VALIDATION; MACHINE LEARNING; NERVOUS SYSTEM PARAMETERS; NEUROIMAGING; PRIORITY JOURNAL; RECOGNITION; RESPONSE TIME; BIOLOGICAL MODEL; BRAIN; ELECTROENCEPHALOGRAPHY; PHYSIOLOGY; PROBABILITY; PROCEDURES; SIGNAL PROCESSING;

BRAIN; ELECTROENCEPHALOGRAPHY; HUMANS; MARKOV CHAINS; MODELS, NEUROLOGICAL; RECOGNITION (PSYCHOLOGY); SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 84930624493     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.12.029     Document Type: Article

References (63)

1. Anderson J.R. How Can the Human Mind Occur in the Physical Universe? 2007, Oxford University Press, New York.
2. Anderson J.R., Fincham J.M. Discovering the sequential structure of thought. Cogn. Sci. 2013, 37(6):1-31.
3. Anderson J.R., Reder L.M. The fan effect: new results and new theories. J. Exp. Psychol. Gen. 1999, 128(2):186-197.10.1037/0096-3445.128.2.186.
4. Anderson J.R., Betts S., Ferris J.L., Fincham J.M. Neural imaging to track mental states while using an intelligent tutoring system. Proc. Natl. Acad. Sci. U. S. A. 2010, 107(15):7018-7023.10.1073/pnas.1000942107.
5. Anderson J.R., Betts S., Ferris J.L., Fincham J.M. Tracking children's mental states while solving algebra equations. Hum. Brain Mapp. 2012, 33(11):2650-2665.10.1002/hbm.21391.
6. Anderson J.R., Fincham J.M., Schneider D.W., Yang J. Using brain imaging to track problem solving in a complex state space. NeuroImage 2012, 60(1):633-643.10.1016/j.neuroimage.2011.12.025.
7. Borst J.P., Schneider D.W., Walsh M.M., Anderson J.R. Stages of processing in associative recognition: evidence from behavior, electroencephalography, and classification. J. Cogn. Neurosci. 2013, 25(12):2151-2166.
8. Britz J., Michel C.M. State-dependent visual processing. Front. Psychol. 2011, 2.10.3389/fpsyg.2011.00370.
9. Brunet D., Murray M.M., Michel C.M. Spatiotemporal analysis of multichannel EEG: CARTOOL. Comput. Intell. Neurosci. 2011, 2011:813870.10.1155/2011/813870.
10. Clark S.E., Gronlund S.D. Global matching models of recognition memory: how the models match the data. Psychon. Bull. Rev. 1996, 3(1):37-60.10.3758/BF03210740.
11. Coltheart M. Methods for modular modelling: additive factors and cognitive neuropsychology. Cogn. Neuropsychol. 2011, 28(3-4):224-240.10.1080/02643294.2011.587794.
12. Colzato L., Bajo M., Van Den Wildenberg W., Paolieri D., Nieuwenhuis S., La Heij W., Hommel B. How does bilingualism improve executive control? A comparison of active and reactive inhibition mechanisms. J. Exp. Psychol. Learn. Mem. Cogn. 2008, 34(2):302-312.10.1037/0278-7393.34.2.302.
13. Danker J.F., Gunn P., Anderson J.R. A rational account of memory predicts left prefrontal activation during controlled retrieval. Cereb. Cortex 2008, 18(11):2674-2685.10.1093/cercor/bhn027.
14. Delorme A., Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 2004, 134(1):9-21.10.1016/j.jneumeth.2003.10.009.
15. Dempster A.P., Laird N.M., Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B Methodol. 1977, 1-38.
16. Diana R.A., Reder L.M., Arndt J., Park H. Models of recognition: a review of arguments in favor of a dual-process account. Psychon. Bull. Rev. 2006, 13(1):1-21.10.3758/BF03193807.
17. Donders F.C. De snelheid van psychische processen (On the speed of mental processes) 1868.
18. Finnigan S., Humphreys M.S., Dennis S., Geffen G. ERP "old/new" effects: memory strength and decisional factor(s). Neuropsychologia 2002, 40(13):2288-2304.10.1016/S0028-3932(02)00113-6.
19. Genovese C.R., Lazar N.A., Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. NeuroImage 2002, 15(4):870-878.10.1006/nimg.2001.1037.
20. Gillund G., Shiffrin R.M. A retrieval model for both recognition and recall. Psychol. Rev. 1984, 91(1):1-67.
21. Gronlund S.D., Ratcliff R. Time course of item and associative information: implications for global memory models. J. Exp. Psychol. Learn. Mem. Cogn. 1989, 15(5):846-858.
22. Hauk O., Pulvermüller F. Effects of word length and frequency on the human event-related potential. Clin. Neurophysiol. 2004, 115(5):1090-1103.
23. Hauk O., Davis M.H., Ford M., Pulvermüller F., Marslen-Wilson W.D. The time course of visual word recognition as revealed by linear regression analysis of ERP data. NeuroImage 2006, 30(4):1383-1400.10.1016/j.neuroimage.2005.11.048.
24. Hauk O., Pulvermüller F., Ford M., Marslen-Wilson W.D., Davis M.H. Can I have a quick word? Early electrophysiological manifestations of psycholinguistic processes revealed by event-related regression analysis of the EEG. Biol. Psychol. 2009, 80(1):64-74.10.1016/j.biopsycho.2008.04.015.
25. Heil M., Rösler F., Hennighausen E. Topography of brain electrical activity dissociates the retrieval of spatial versus verbal information from episodic long-term memory in humans. Neurosci. Lett. 1997, 222(1):45-48.
26. Henson R.N. How to discover modules in mind and brain: the curse of nonlinearity, and blessing of neuroimaging. A comment on Sternberg (2011). Cogn. Neuropsychol. 2011, 28(3-4):209-223.10.1080/02643294.2011.561305.
27. Hintzman D.L. Judgments of frequency and recognition memory in a multiple-trace memory model. Psychol. Rev. 1988, 95(4):528-551.10.1037/0033-295X.95.4.528.
28. Juhasz B.J., Rayner K. Investigating the effects of a set of intercorrelated variables on eye fixation durations in reading. J. Exp. Psychol. Learn. Mem. Cogn. 2003, 29(6):1312-1318.10.1037/0278-7393.29.6.1312.
29. Khader P., Heil M., Rösler F. Material-specific long-term memory representations of faces and spatial positions: evidence from slow event-related brain potentials. Cogn. Psychol. 2005, 43(14):2109-2124.10.1016/j.neuropsychologia.2005.03.012.
30. Khader P., Knoth K., Burke M., Ranganath C., Bien S., Rösler F. Topography and dynamics of associative long-term memory retrieval in humans. J. Cogn. Neurosci. 2007, 19(3):493-512.10.1162/jocn.2007.19.3.493.
31. Lehmann D., Strik W.K., Henggeler B., Koenig T., Koukkou M. Brain electric microstates and momentary conscious mind states as building blocks of spontaneous thinking: I. Visual imagery and abstract thoughts. Int. J. Psychophysiol. 1998, 29(1):1-11.10.1016/S0167-8760(97)00098-6.
32. Luck S.J. An Introduction to the Event-Related Potential Technique 2005, MIT Press.
33. Malmberg K.J. Recognition memory: a review of the critical findings and an integrated theory for relating them. Cogn. Psychol. 2008, 57(4):335-384.10.1016/j.cogpsych.2008.02.004.
34. Murdock B.B. TODAM2: a model for the storage and retrieval of item, associative, and serial-order information. Psychol. Rev. 1993, 100(2):183-203.10.1037/0033-295X.100.2.183.
35. Nieuwenhuis S., Aston-Jones G., Cohen J.D. Decision making, the P3, and the locus coeruleus-norepinephrine system. Psychol. Bull. 2005, 131(4):510-532.10.1037/0033-2909.131.4.510.
36. Nyhus E., Curran T. Semantic and perceptual effects on recognition memory: evidence from ERP. Brain Res. 2009, 1283:102-114.10.1016/j.brainres.2009.05.091.
37. Pascual-Marqui R.D., Michel C.M., Lehmann D. Segmentation of brain electrical activity into microstates: model estimation and validation. IEEE Trans. Biomed. Eng. 1995, 42(7):658-665.
38. Pirolli P.L., Anderson J.R. The role of practice in fact retrieval. J. Exp. Psychol. Learn. Mem. Cogn. 1985, 11(1):136.
39. Rabiner L.R. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 1989, 77(2):257-286.
40. Ratcliff R., McKoon G. Similarity information versus relational information: differences in the time course of retrieval. Cogn. Psychol. 1989, 21(2):139-155.10.1016/0010-0285(89)90005-4.
41. Ratcliff R., Murdock B.B. Retrieval processes in recognition memory. Psychol. Rev. 1976, 83(3):190.
42. Reder L.M., Nhouyvanisvong A., Schunn C.D., Ayers M.S., Angstadt P., Hiraki K. A mechanistic account of the mirror effect for word frequency: a computational model of remember-know judgments in a continuous recognition paradigm. J. Exp. Psychol. Learn. Mem. Cogn. 2000, 26(2):294-320.10.1037/0278-7393.26.2.294.
43. Roberts S., Sternberg S. The meaning of additive reaction-time effects: tests of three alternatives. Attention and Performance XIV: Synergies in Experimental Psychology, Artificial Intelligence, and Cognitive Neuroscience 1993, vol. 14:611-653.
44. Rotello C.M., Heit E. Associative recognition: a case of recall-to-reject processing. Mem. Cogn. 2000, 28(6):907-922.10.3758/BF03209339.
45. Rugg M.D., Curran T. Event-related potentials and recognition memory. Trends Cogn. Sci. 2007, 11(6):251-257.10.1016/j.tics.2007.04.004.
46. Schneider D.W., Anderson J.R. Modeling fan effects on the time course of associative recognition. Cogn. Psychol. 2012, 64(3):127-160.10.1016/j.cogpsych.2011.11.001.
47. Sohn M.H., Goode A., Stenger V.A., Jung K.J., Carter C.S., Anderson J.R. An information-processing model of three cortical regions: evidence in episodic memory retrieval. NeuroImage 2005, 25(1):21-33.10.1016/j.neuroimage.2004.11.001.
48. Speer N.K., Curran T. ERP correlates of familiarity and recollection processes in visual associative recognition. Brain Res. 2007, 1174:97-109.10.1016/j.brainres.2007.08.024.
49. Spinelli D., De Luca M., Di Filippo G., Mancini M., Martelli M., Zoccolotti P. Length effect in word naming in reading: role of reading experience and reading deficit in Italian readers. Dev. Neuropsychol. 2005, 27(2):217-235.10.1207/s15326942dn2702_2.
50. Sternberg S. The discovery of processing stages: extensions of Donders' method. Acta Psychol. 1969, 30:276-315.10.1016/0001-6918(69)90055-9.
51. Sternberg S. Modular processes in mind and brain. Cogn. Neuropsychol. 2011, 28(3-4):156-208.10.1080/02643294.2011.557231.
52. Sudre G., Pomerleau D., Palatucci M., Wehbe L., Fyshe A., Salmelin R., Mitchell T. Tracking neural coding of perceptual and semantic features of concrete nouns. NeuroImage 2012, 62(1):451-463.10.1016/j.neuroimage.2012.04.048.
53. Sutton S., Ruchkin D.S., Munson R., Kietzman M.L., Hammer M. Event-related potentials in a two-interval forced-choice detection task. Psychon. Bull. Rev. 1982, 32(4):360-374.10.3758/BF03206242.
54. Taatgen N.A., Juvina I., Schipper M., Borst J.P., Martens S. Too much control can hurt: a threaded cognition model of the attentional blink. Cogn. Psychol. 2009,10.1016/j.cogpsych.2008.12.002.
55. Van De Ville D., Britz J., Michel C.M. EEG microstate sequences in healthy humans at rest reveal scale-free dynamics. Proc. Natl. Acad. Sci. U. S. A. 2010, 107(42):18179-18184.10.1073/pnas.1007841107.
56. Van Petten C., Kutas M. Interactions between sentence context and word frequency in event-related brain potentials. Mem. Cogn. 1990, 18(4):380-393.
57. Wilkinson R.T., Seales D.M. EEG event-related potentials and signal detection. Biol. Psychol. 1978, 7(1):13-28.10.1016/0301-0511(78)90039-X.
58. Wixted J.T. Dual-process theory and signal-detection theory of recognition memory. Psychol. Rev. 2007, 114(1):152.
59. Wixted J.T., Stretch V. In defense of the signal detection interpretation of remember/know judgments. Psychon. Bull. Rev. 2004, 11(4):616-641.10.3758/BF03196616.
60. Yonelinas A.P. The nature of recollection and familiarity: a review of 30years of research. J. Mem. Lang. 2002, 46(3):441-517.10.1006/jmla.2002.2864.
61. Yu S.Z. Hidden semi-Markov models. Artif. Intell. 2010, 174(2):215-243.10.1016/j.artint.2009.11.011.
62. Yu S.Z., Kobayashi H. An efficient forward-backward algorithm for an explicit-duration hidden Markov model. IEEE Signal Process. Lett. 2003, 10(1):11-14.
63. Yu S.Z., Kobayashi H. Practical implementation of an efficient forward-backward algorithm for an explicit-duration hidden Markov model. Signal Process. IEEE Trans. 2006, 54(5):1947-1951.