Closing the loop in cortically-coupled computer vision: A brain-computer interface for searching image databases

Journal of Neural Engineering

Volumn 8, Issue 3, 2011, Pages

  Pohlmeyer, Eric A ^a   Wang, Jun ^a   Jangraw, David C ^a   Lou, Bin ^a   Chang, Shih Fu ^a   Sajda, Paul ^a  

^a Department of Earth and Environmental Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ATTENTIONAL SHIFT; CLOSED-LOOP; COMPUTER VISION SYSTEM; DATABASE SEARCHES; GRAPH-BASED REPRESENTATIONS; IMAGE DATABASE; OPEN LOOPS; RAPID SERIAL VISUAL PRESENTATIONS; RESAMPLING; SELF-MONITORING; SEMI-SUPERVISED; TARGET DETECTION; TARGET IMAGES; VISUAL SIMILARITY;

COMPUTER VISION; DATABASE SYSTEMS; INTERFACES (COMPUTER); SEARCH ENGINES;

BRAIN COMPUTER INTERFACE;

ARTICLE; BRAIN COMPUTER INTERFACE; DATA BASE; ELECTROENCEPHALOGRAPHY; IMAGE DISPLAY; IMAGE PROCESSING; IMAGING; INFORMATION PROCESSING; PRIORITY JOURNAL; RAPID SERIAL VISUAL PRESENTATION; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER INTERFACE; FACTUAL DATABASE; HOSPITAL INFORMATION SYSTEM; METHODOLOGY;

ARTIFICIAL INTELLIGENCE; DATABASE MANAGEMENT SYSTEMS; DATABASES, FACTUAL; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; RADIOLOGY INFORMATION SYSTEMS; USER-COMPUTER INTERFACE;

EID: 79957941499     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/8/3/036025     Document Type: Article

References (56)

1. Thorpe S, Fize D and Marlot C 1996 Speed of processing in the human visual system Nature 381 520-2 (Pubitemid 26170929)
2. Oliva A 2005 Gist of the scene Encyclopedia of Neurobiology of Attention (San Diego, CA: Elsevier) pp 251-6
3. Gerson A D, Parra L C and Sajda P 2006 Cortically-coupled computer vision for rapid image search IEEE Trans. Neural Syst. Rehabil. Eng. 14 174-9 (Pubitemid 44150235)
4. Parra L C, Christoforou C, Gerson A D, Dyrholm M, Luo A, Wagner M, Philiastides M G and Sajda P 2008 Spatiotemporal linear decoding of brain state: application to performance augmentation in high-throughput tasks IEEE Signal Process. Mag. 25 95-115
5. Sajda P, Pohlmeyer E, Wang J, Parra L C, Christoforou C, Dmochowski J, Hanna B, Bahlmann C, Singh M K and Chang S-F 2010 In a blink of an eye and a switch of a transistor: cortically coupled computer vision Proc. IEEE 98 462-78
6. Iturrate I, Antelis J M, Kubler A and Minguez J 2009 A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation IEEE Trans. Robot. 25 614-27
7. Bentley A S J, Andrew C M and John L R 2008 An offline auditory P300 brain-computer interface using principal and independent component analysis techniques for functional electrical stimulation application Conf. Proc. IEEE Eng. Med. Biol. Soc. 2008 4660-3
8. Daly J J and Wolpaw J R 2008 Brain-computer interfaces in neurological rehabilitation Lancet Neurol. 7 1032-43
9. Farwell L A and Donchin E 1988 Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials Electroencephalogr. Clin. Neurophysiol. 70 510-23
10. Leuthardt E C, Schalk G, Roland J, Rouse A and Moran D W 2009 Evolution of brain-computer interfaces: going beyond classic motor physiology Neurosurg. Focus 27 E4
11. Lotte F, Congedo M, Lècuyer A, Lamarche F and Arnaldi B 2007 A review of classification algorithms for EEG-based brain-computer interfaces J. Neural Eng. 4 R1-13
12. McFarland D J, Sarnacki W A and Wolpaw J R 2010 Electroencephalographic (EEG) control of three-dimensional movement J. Neural Eng. 7 036007
13. Millàn J D R et al 2010 Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges Front. Neurosci. 4
14. Pfurtscheller G, Müller G R, Pfurtscheller J, Gerner H J and Rupp R 2003 'Thought'-control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia Neurosci. Lett. 351 33-6 (Pubitemid 37205178)
15. Millàn J D R, Renkens F, Mouriño J and Gerstner W 2004 Noninvasive brain-actuated control of a mobile robot by human EEG IEEE Trans. Biomed. Eng. 51 1026-33 (Pubitemid 38661458)
16. Wolpaw J R, Birbaumer N, McFarland D J, Pfurtscheller G and Vaughan T M 2002 Brain-computer interfaces for communication and control Clin. Neurophysiol. 113 767-91
17. Wolpaw J R and McFarland D J 2004 Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans Proc. Natl Acad. Sci. USA 101 17849-54
18. Rebsamen B, Guan C, Zhang H, Wang C, Teo C, Ang M H and Burdet E 2010 A brain controlled wheelchair to navigate in familiar environments IEEE Trans. Neural Syst. Rehabil. Eng. 18 590-8
19. Linden D E J 2005 The P300: where in the brain is it produced and what does it tell us? Neuroscientist 11 563-76 (Pubitemid 41611868)
20. Polich J 2007 Updating P300: an integrative theory of P3a and P3b Clin. Neurophysiol. 118 2128-48 (Pubitemid 47385341)
21. Sutton S, Braren M, Zubin J and John E R 1965 Evoked-potential correlates of stimulus uncertainty Science 150 1187-8
22. Lenhardt A, Kaper M and Ritter H J 2008 An adaptive P300-based online brain-computer interface IEEE Trans. Neural Syst. Rehabil. Eng. 16 121-30 (Pubitemid 351519526)
23. Krusienski D J, Sellers E W, McFarland D J, Vaughan T M and Wolpaw J R 2008 Toward enhanced P300 speller performance J. Neurosci. Methods 167 15-21
24. Klobassa D S, Vaughan T M, Brunner P, Schwartz N E, Wolpaw J R, Neuper C and Sellers E W 2009 Toward a high-throughput auditory P300-based brain-computer interface Clin. Neurophysiol. 120 1252-61
25. Guger C, Daban S, Sellers E, Holzner C, Krausz G, Carabalona R, Gramatica F and Edlinger G 2009 How many people are able to control a P300-based brain-computer interface (BCI)? Neurosci. Lett. 462 94-8
26. Poolman P, Frank R M, Luu P, Pederson S M and Tucker D M 2008 A single-trial analytic framework for EEG analysis and its application to target detection and classification Neuroimage 42 787-98
27. Bigdely-Shamlo N, Vankov A, Ramirez R R and Makeig S 2008 Brain activity-based image classification from rapid serial visual presentation IEEE Trans. Neural Syst. Rehabil. Eng. 16 432-41
28. Wang J, Pohlmeyer E, Hanna B, Jiang Y-G, Sajda P and Chang S-F 2009 Brain state decoding for rapid image retrieval MM '09: Proc. 17th ACM Int. Conf. on Multimedia (New York: ACM) pp 945-54
29. Fetz E E 2007 Volitional control of neural activity: implications for brain-computer interfaces J. Physiol. 579 (Pt 3) 571-9 (Pubitemid 46404342)
30. Wessberg J, Stambaugh C R, Kralik J D, Beck P D, Laubach M, Chapin J K, Kim J, Biggs S J, Srinivasan M A and Nicolelis M A 2000 Real-time prediction of hand trajectory by ensembles of cortical neurons in primates Nature 408 361-5
31. Taylor D M, Tillery S I H and Schwartz A B 2002 Direct cortical control of 3D neuroprosthetic devices Science 296 1829-32 (Pubitemid 34596262)
32. Schwartz A B, Cui X T, Weber D J and Moran D W 2006 Brain-controlled interfaces: movement restoration with neural prosthetics Neuron 52 205-20 (Pubitemid 44466359)
33. Koyama S, Chase S M, Whitford A S, Velliste M, Schwartz A B and Kass R E 2010 Comparison of brain-computer interface decoding algorithms in open-loop and closed-loop control J. Comput. Neurosci. 29 73-87
34. Carmena J M, Lebedev M A, Crist R E, O'Doherty J E, Santucci D M, Dimitrov D F, Patil P G, Henriquez C S and Nicolelis M A L 2003 Learning to control a brain-machine interface for reaching and grasping by primates PLoS Biol. 1 E42
35. Fei-Fei L, Fergus R and Perona P 2004 Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories Proc. Conf. Computer Vision and Pattern Recognition Workshop CVPRW '04 p 178
36. Potter M C and Levy E I 1969 Recognition memory for a rapid sequence of pictures J. Exp. Psychol. 81 10-5
37. Wang J and Chang S-F 2008 Columbia TAG system - transductive annotation by graph version 1.0 Technical report, Columbia University, NY, USA
38. Wang J, Jebara T and Chang S-F 2008 Graph transduction via alternating minimization ICML '08: Proc. 25th Int. Conf. on Machine Learning (New York: ACM) pp 1144-51
39. Wang J, Jiang Y-G and Chang S-F 2009 Label diagnosis through self tuning for web image search Proc. IEEE Conf. Computer Vision and Pattern Recognition CVPR 2009 pp 1390-7
40. Jebara T, Wang J and Chang S-F 2009 Graph construction and bmatching for semi-supervised learning Int. Conf. on Machine Learning pp 441-8
41. Oliva A and Torralba A 2001 Modeling the shape of the scene: a holistic representation of the spatial envelope Int. J. Comput. Vis. 42 145-75 (Pubitemid 32680801)
42. Griffin G, Holub A and Perona P 2007 Caltech-256 object category dataset Technical Report 7694 California Institute of Technology, CA, USA
43. Smeaton A F, Over P and Kraaij W 2006 Evaluation campaigns and TRECVid MIR '06: Proc. 8th ACM Int. Workshop on Multimedia Information Retrieval (New York: ACM) pp 321-30
44. Buckley C and Voorhees E M 2000 Evaluating evaluation measure stability Proc. 23rd Annu. Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, SIGIR '00 (New York: ACM) pp 33-40
45. Polich J and Margala C 1997 P300 and probability: comparison of oddball and single-stimulus paradigms Int. J. Psychophysiol. 25 169-76 (Pubitemid 27142006)
46. Polich J, Ellerson P C and Cohen J 1996 P300, stimulus intensity, modality, and probability Int. J. Psychophysiol. 23 55-62 (Pubitemid 26313021)
47. Heinrich S P and Bach M 2008 Signal and noise in P300 recordings to visual stimuli Doc. Ophthalmol. 117 73-83
48. Cohen J and Polich J 1997 On the number of trials needed for P300 Int. J. Psychophysiol. 25 249-55 (Pubitemid 27153755)
49. Bonala B, Boutros N N and Jansen B H 2008 Target probability affects the likelihood that a P300 will be generated in response to a target stimulus, but not its amplitude Psychophysiology 45 93-9 (Pubitemid 350233280)
50. Vogel E K and Luck S J 2000 The visual N1 component as an index of a discrimination process Psychophysiology 37 190-203 (Pubitemid 30140284)
51. Luck S J, Woodman G F and Vogel E K 2000 Event-related potential studies of attention Trends Cogn. Sci. 4 432-40
52. Wascher E, Hoffmann S, Sänger J and Grosjean M 2009 Visuo-spatial processing and the N1 component of the ERP Psychophysiology 46 1270-7
53. Scheffers M K and Coles M G 2000 Performance monitoring in a confusing world: error-related brain activity, judgments of response accuracy, and types of errors J. Exp. Psychol. Hum. Percept. Perform. 26 141-51
54. Botvinick M M, Cohen J D and Carter C S 2004 Conflict monitoring and anterior cingulate cortex: an update Trends Cogn. Sci. 8 539-46 (Pubitemid 39536251)
55. Xu J and Croft W B 1996 Query expansion using local and global document analysis Proc. 19th Annu. Int. ACM SIGIR Conf. on Research and Development in Information Retrieval pp 4-11
56. Raymond J E, Shapiro K L and Arnell K M 1992 Temporary suppression of visual processing in an RSVP task: an attentional blink? J. Exp. Psychol. Hum. Percept. Perform. 18 849-60