Toward a direct measure of video quality perception using EEG

IEEE Transactions on Image Processing

Volumn 21, Issue 5, 2012, Pages 2619-2629

  Scholler, Simon ^a   Bosse, Sebastian ^c   Treder, Matthias Sebastian ^a   Blankertz, Benjamin ^a   Curio, Gabriel ^d   Müller, Klaus Robert ^a,b   Wiegand, Thomas ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b Korea University   (South Korea)

^c FRAUNHOFER HEINRICH HERTZ INSTITUTE   (Germany)

^d CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

Author keywords

Electroencephalography (EEG); perception; video coding; video quality

Indexed keywords

BRAIN ACTIVITY; BRAIN RESPONSE; DIRECT MEASUREMENT; DIRECT MEASURES; ELECTROENCEPHALOGRAPHIES (EEG); MACHINE LEARNING TECHNIQUES; POSITIVE VOLTAGE; QUALITY CHANGE; QUALITY LEVELS; REAL-TIME APPLICATION; SPECIFIC COMPONENT; TIME POINTS; VIDEO ASSESSMENT; VIDEO CLIPS; VIDEO CODECS; VIDEO QUALITY; VIDEO SIGNAL; VOLTAGE CHANGE;

ELECTROPHYSIOLOGY; IMAGE CODING; SENSORY PERCEPTION; VIDEO CAMERAS; VIDEO SIGNAL PROCESSING;

ELECTROENCEPHALOGRAPHY;

ADULT; ARTICLE; ARTIFICIAL INTELLIGENCE; BRAIN; COMPUTER ASSISTED DIAGNOSIS; ELECTROENCEPHALOGRAPHY; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; MALE; METHODOLOGY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VIDEORECORDING; VISION; VISION TEST;

ADULT; ARTIFICIAL INTELLIGENCE; BRAIN; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; FEMALE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MALE; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING; VISION TESTS; VISUAL PERCEPTION;

EID: 84860112691     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2187672     Document Type: Article

References (38)

1. K. Seshadrinathan and A. C. Bovik, "Motion tuned spatio-temporal quality assessment of natural videos," IEEE Trans. Image Process., vol. 19, no. 2, pp. 335-350, Feb. 2010.
2. A. B. Watson and J. Malo, "Video quality measures based on the standard spatial observer," in Proc. ICIP, Rochester, NY, 2002, pp. III-41-III-44.
3. Methodology for the Subjective Assessment of the Quality of Television Pictures, Rec. ITU-R BT.500-11, 2002.
4. Subjective Video Quality AssessmentMethods forMultimedia Applications, Rec. ITU-T P.910, 2008.
5. J. Polich, "Updating P300: An integrative theory of P3a and P3b," Clin. Neurophysiol., vol. 118, no. 10, pp. 2128-2148, Oct. 2007.
6. P. Nunez, R. Srinivasan, A. Westdorp, R. Wijesinghe, D. Tucker, R. Silberstein, and P. Cadusch, "EEG coherency: I: Statistics, reference electrode, volume conduction, Laplacians, cortical imaging, and interpretation at multiple scales," Electroencephalogr. Clin. Neurophysiol., vol. 103, no. 5, pp. 499-515, Nov. 1997.
7. L. Farwell and E. Donchin, "Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials," Electroencephalogr. Clin. Neurophysiol., vol. 70, no. 6, pp. 510-523, Dec. 1988.
8. M. S. Treder, N. M. Schmidt, and B. Blankertz, "Gaze-independent brain-computer interfaces based on covert attention and feature attention," J. Neural Eng. vol. 8, no. 6, p. 066003, Oct. 2011 [Online].Available: http://dx.doi.org/10.1088/1741-2560/8/6/066003
9. M. Schreuder, B. Blankertz, and M. Tangermann, "A new auditory multi-class brain-computer interface paradigm: Spatial hearing as an informative cue," PLoS One, vol. 5, no. 4, p. e9813, Apr. 2010.
10. J. Höhne, M. Schreuder, B. Blankertz, and M. Tangermann, "Two-dimensional auditory P300 speller with predictive text system," in Proc. IEEE Annu. Int. Conf. EMBC, 2010, pp. 4185-4188.
11. A. Porbadnigk, J. Antons, B. Blankertz, M. S. Treder, R. Schleicher, S. Möller, and G. Curio, "Using ERPs for assessing the (sub) conscious perception of noise," in Proc. IEEE Annu. Int. Conf. EMBC, 2010, pp. 2690-2693.
12. B. Blankertz, G. Dornhege, M. Krauledat, K.-R. Müller, and G. Curio, "The non-invasive Berlin brain-computer interface: Fast acquisition of effective performance in untrained subjects," Neuroimage vol. 37, no. 2, pp. 539-550, Aug. 2007 [Online]. Available: http://dx.doi.org/10. 1016/j.neuroimage.2007.01.051
13. Toward Brain-Computer Interfacing, G. Dornhege, J. del R. Millán, T. Hinterberger, D. McFarland, and K.-R. Müller, Eds. Cambridge, MA: MIT Press, 2007.
14. B. Blankertz, R. Tomioka, S. Lemm, M. Kawanabe, and K.-R. Müller, "Optimizing spatial filters for robust EEG single-trial analysis," IEEE Signal Process. Mag. vol. 25, no. 1, pp. 41-56, Jan. 2008 [Online]. Available: http://dx.doi.org/10.1109/MSP.2008.4408441
15. C. Gerald and P. Wheatley, Applied Numerical Analysis. Reading, MA: Addison-Wesley, 1989.
16. D. Marpe, H. Schwarz, S. Bosse, B. Bross, P. Helle, T. Hinz, H. Kirchhoffer, H. Lakshman, T. Nguyen, S. Oudin, M. Siekmann, K. Suhring, M. Winken, and T. Wiegand, "Video compression using nested quadtree structures, leaf merging, and improved techniques for motion representation and entropy coding," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 12, pp. 1676-1687, Dec. 2010.
17. T. Wiegand, W.-J. Han, B. Bross, J.-R. Ohm, and G. J. Sullivan, JCTVC, WD3: Working Draft 3 of High-Efficiency Video Coding Mar. 2011.
18. I. Fründ, N. Haenel, and F. Wichmann, "Inference for psychometric functions in the presence of nonstationary behavior," J. Vis., vol. 11, no. 6, p. 16, May 2011.
19. R. Duda, P. Hart, and D. Stork, Pattern Classification. NewYork: Wiley, 2001.
20. J. Schäfer and K. Strimmer, "A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics," Stat. Appl. Genetics Mol. Biol., vol. 4, no. 1, p. 32, 2005.
21. B. Blankertz, S. Lemm, M. S. Treder, S. Haufe, and K.-R. Müller, "Single-trial analysis and classification of ERP components-a tutorial," Neuroimage, vol. 56, no. 2, pp. 814-825, May 2011.
22. K.-R. Müller, C. Anderson, and G. Birch, "Linear and nonlinear methods for brain-computer interfaces," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 11, no. 2, pp. 165-169, Jun. 2003.
23. D. Green and J. Swets, Signal Detection Theory and Psychophysics. Huntington, NY: Krieger, 1974.
24. G. Hagen, J. Gatherwright, B. Lopez, and J. Polich, "P3a from visual stimuli: Task difficulty effects," Int. J. Psychophysiol., vol. 59, no. 1, pp. 8-14, Jan. 2006.
25. K. Kim, J. Kim, J. Yoon, and K. Jung, "Influence of task difficulty on the features of event-related potential during visual oddball task," Neurosci. Lett., vol. 445, no. 2, pp. 179-183, Nov. 2008.
26. J. Polich, P. Ellerson, and J. Cohen, "P300, stimulus intensity,modality, and probability," Int. J. Psychophysiol., vol. 23, no. 1/2, pp. 55-62, Aug./Sep. 1996.
27. J. Polich and A. Kok, "Cognitive and biological determinants of P300: An integrative review," Biol. Psychol., vol. 41, no. 2, pp. 103-146, Oct. 1995.
28. F.Wichmann and N. Hill, "The psychometric function: I. Fitting, sampling, and goodness of fit," Perception Psychophys., vol. 63, no. 8, pp. 1293-1313, Nov. 2001.
29. C. Vidaurre, C. Sannelli, K.-R. Müller, and B. Blankertz, "Machinelearning- based coadaptive calibration for brain-computer interfaces," Neural Comput., vol. 23, no. 3, pp. 1-28, Mar. 2011.
30. P. von Bünau, F. Meinecke, F. Király, and K.-R. Müller, "Finding stationary subspaces in multivariate time series," Phys. Rev. Lett., vol. 103, no. 21, pp. 214 101-1-214 101-4, Nov. 2009.
31. P. von Bünau, F. Meinecke, S. Scholler, and K.-R. Müller, "Finding stationary brain sources in EEG data," in Proc. IEEE Annu. Int. Conf. EMBC, 2010, pp. 2810-2813.
32. C. Vidaurre and B. Blankertz, "Towards a cure for BCI illiteracy," Brain Topography, vol. 23, no. 2, pp. 194-198, Jun. 2010.
33. A. K. Porbadnigk, S. Scholler, B. Blankertz, A. Ritz, M. Born, R. Scholl, K.-R. Müller, G. Curio, and M. S. Treder, "Revealing the neural response to imperceptible peripheral flicker with machine learning," in Proc. IEEE Eng. Med. Biol. Soc. Conf., 2011, vol. 2011, pp. 3692-3695.
34. H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1103-1120, Sep. 2007.
35. B. Blankertz, C. Sannelli, S. Halder, E. Hammer, A. Kübler, K.-R. Müller, G. Curio, and T. Dickhaus, "Neurophysiological predictor of SMR-based BCI performance," NeuroImage, vol. 51, no. 4, pp. 1303-1309, Jul. 2010.
36. M. S. Treder, A. Bahramisharif,N.M. Schmidt, M. vanGerven, andB. Blankertz, "Brain-computer interfacing usingmodulations of alpha activity induced by covert shifts of attention," J. Neuroeng. Rehabil. vol. 8, p. 24, May 2011 [Online]. Available: http://www.jneuroengrehab. com/content/8/1/24/abstract
37. F. Popescu, S. Fazli, Y. Badower, B. Blankertz, and K.-R. Müller, "Single trial classification of motor imagination using 6 dry EEG electrodes," PloS one, vol. 2, no. 7, p. e637, Jul. 2007.
38. C. Grozea, C. Voinescu, and S. Fazli, "Bristle-sensors-Low-cost flexible passive dry EEG electrodes for neurofeedback and BCI applications," J. Neural Eng., vol. 8, no. 2, p. 025008, Mar. 2011.