Quality of experience evaluation of voice communication: an affect-based approach

Human-centric Computing and Information Sciences

Volumn 2, Issue 1, 2012, Pages 1-18

  Bhattacharya, Abhishek ^a   Wu, Wanmin ^b   Yang, Zhenyu ^a  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

^b University of Illinois at Urbana Champaign   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); INTERNET TELEPHONY; NEAREST NEIGHBOR SEARCH; QUALITY CONTROL; SUPPORT VECTOR MACHINES; TELEPHONE SETS; USER EXPERIENCE; VOICE/DATA COMMUNICATION SYSTEMS;

CLASSIFICATION PROCEDURE; EVALUATION FRAMEWORK; INFORMATION SOURCES; K NEAREST NEIGHBOR (KNN); MOBILE TELEPHONE NETWORKS; PUBLIC SWITCHED TELEPHONE NETWORK; QUALITY OF EXPERIENCE (QOE); UNDERLYING NETWORKS;

QUALITY OF SERVICE;

EID: 84868566462     PISSN: None     EISSN: 21921962     Source Type: Journal    
DOI: 10.1186/2192-1962-2-7     Document Type: Article

References (65)

1. Jaimes A, Sebe N, Gatica-Perez D: Human-centered computing: a multimedia perspective. [http://doi.acm.org/10.1145/1180639.1180829]ACM international conference on Multimedia. MULTIMEDIA '06, New York 2006.
2. Jain R: Quality of experience.Multimedia IEEE 2004., 11:
3. Tasaka S, Yoshimi H, Hirashima A, Toshiro N: The effectiveness of a QoE-based video output scheme for audio-video ip transmission. [http://doi.acm.org/10.1145/1459359.1459395]ACM international conference on Multimedia. MM '08, New York 2008.
4. Ebrahimi T: Quality of multimedia experience: past, present and future. [http://doi.acm.org/10.1145/1631272.1631275]ACM international conference on Multimedia. MM '09, New York 2009.
5. Subjective audiovisual assessment methods for multimedia experienceTech. rep., ITU-T Rec 1998, 911.
6. Beauregard R, Corriveau P: User experience quality: a conceptual framework for goal setting and measurement. [http://portal.acm.org/citation.cfm?id=1784074.1784114]International conference on Digital human modeling. ICDHM'07, Springer-Verlag, Berlin 2007.
7. Wu W, Arefin A, Rivas R, Nahrstedt K, Sheppard R, Yang Z: Quality of experience in distributed interactive multimedia environments: toward a theoretical framework. [http://doi.acm.org/10.1145/1631272.1631338]ACM international conference on Multimedia. MM '09, New York 2009.
8. Forlizzi J, Battarbee K: Understanding experience in interactive systems. [http://doi.acm.org/10.1145/1013115.1013152]Conference on Designing interactive systems: processes, practices, methods, and techniques. DIS '04, New York 2004.
9. Csikszentmihalyi M: Flow: The psychology of Optimal Experience.Harper and Row 1990.
10. Varela F, Thompson E, Rosch E: The Embodied Mind: Cognitive Science and Human Experience. The MIT Press; 1992.
11. Hobbs D, Stuart B: Sociology and the human experience.Wiley 1982.
12. Abowd G, Mynatt E, Rodden T: The human experience [of ubiquitous computing].Pervasive Computing, IEEE 2002., 1:
13. Davis FD, Bagozzi RP, Warshaw PR: User acceptance of computer technology: a comparison of two theoretical models. [http://www.jstor.org/stable/2632151]Manag Sci 1989.,35(8):
14. Venkatesh V, Morris MG, Davis GB, Davis FD: User acceptance of information technology: toward a unified view. [http://www.jstor.org/stable/30036540]MIS Quarterly 2003.,27(3):
15. Chen KT, Tu CC, Xiao WC: OneClick: a framework for measuring network quality of experience.INFOCOM 2009 IEEE 2009.
16. ITU: ITU-T Recommendation P.800:Methods for subjective determination of transmission quality.Geneva 1996.
17. Chen KT, Huang CY, Huang P, Lei CL: Quantifying Skype user satisfaction.Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications. SIGCOMM '06, New York 2006.
18. Sat B, Wah BW: Playout scheduling and loss-concealments in voip for optimizing conversational voice communication quality. [http://doi.acm.org/10.1145/1291233.1291260]ACM International conference on Multimedia. MULTIMEDIA '07, New York 2007.
19. ITU: Perceptual evaluation of speech quality (PESQ): An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codes.Geneva 2001.
20. ITU: ITU-T Recommendation G.107. The E-model, a computational model for use in transmission planning.Geneva 2005.
21. Nahl D: Measuring the affective information environment of web searchers. [http://dx.doi.org/10.1002/meet.1450410122]American society for information science and technology 2004., 41:
22. Nahl D: Learning the Internet and the structure of information behavior. [http://portal.acm.org/citation.cfm?id=288129.288148]J Am Soc Inf Sci 1998., 49:
23. Tenopir C, Wang P, Zhang Y, Simmons B, Pollard R: Academic users' interactions with sciencedirect in search tasks: affective and cognitive behaviors. [http://portal.acm.org/citation.cfm?id=1314720.1315078]Inf Process Manage 2008., 44:
24. Kracker J: Research anxiety and students' perceptions of research: an experiment. Part I: Effect of teaching Kuhlthau's ISP model. [http://portal.acm.org/citation.cfm?id=507286.507289]J Am Soc Inf Sci Technol 2002., 53:
25. Zeng Z, Pantic M, Roisman G, Huang T: A survey of affect recognition methods: audio, visual, and spontaneous expressions.Pattern Analysis and Machine Intelligence, IEEE Transactions on 2009, 31.
26. Kapoor A, Picard RW: Multimodal affect recognition in learning environments. [http://doi.acm.org/10.1145/1101149.1101300].ACM international conference on Multimedia. MULTIMEDIA '05, New York 2005.
27. Pelachaud C: Multimodal expressive embodied conversational agents. [http://doi.acm.org/10.1145/1101149.1101301].ACM international conference on Multimedia. MULTIMEDIA '05, New York 2005.
28. Calvo R, D'Mello S: Affect detection: an interdisciplinary review of models, methods, and their applications.IEEE Trans Affect Comput 2010., 1:
29. Arapakis I, Jose JM, Gray PD: Affective feedback: an investigation into the role of emotions in the information seeking process.ACM SIGIR conference on Research and development in information retrieval. SIGIR '08, New York 2008.
30. Arapakis I, Konstas I, Jose JM: Using facial expressions and peripheral physiological signals as implicit indicators of topical relevance.ACM international conference on Multimedia. MM '09, New York 2009.
31. Vinciarelli A, Pantic M, Bourlard H, Pentland A: Social signal processing: state-of-the-art and future perspectives of an emerging domain. [http://doi.acm.org/10.1145/1459359.1459573]ACM international conference on Multimedia > MM '08, New York 2008.
32. Vinciarelli A, Pantic M, Bourlard H: Social signal processing: Survey of an emerging domain. [http://dl.acm.org/citation.cfm?id=1621144.1621310]Image Vision Comput 2009, 27:1743–1759.
33. Curhan JR, Pentland A: Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. [http://www.sciencedirect.com/science/article/pii/S0021901007670058]J Appl Psychol 2007,92(3):802–811.
34. Cowie R, Douglas-Cowie E, Tsapatsoulis N, Votsis G, Kollias S, Fellenz W, Taylor J: Emotion recognition in human-computer interaction.Signal Processing Magazine, IEEE 2001., 18:
35. Batliner A, Fischer K, Huber R, Spilker J, Nöth E: How to find trouble in communication. [http://portal.acm.org/citation.cfm?id=772592.772600]Speech Commun 2003., 40:
36. Lee CM, Narayanan S: Toward detecting emotions in spoken dialogs.IEEE Transactions on Speech and Audio Processing 2005.,13(2):
37. Knoche H, Meer HGD, Kirsh D: Utility curves: mean opinion scores considered biased.International conference on Quality of Service. IWQoS'99 1999.
38. Watson A, Sasse MA: Measuring perceived quality of speech and video in multimedia conferencing applications. [http://doi.acm.org/10.1145/290747.290755]ACM international conference on Multimedia. MULTIMEDIA '98, New York 1998.
39. Markopoulou A, Tobagi F, Karam M: Assessment of VoIP quality over Internet backbones.INFOCOM 2002. Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE 2002., 1:
40. Wu CC, Chen KT, Huang CY, Lei CL: An empirical evaluation of VoIP playout buffer dimensioning in Skype, Google talk, and MSN Messenger.International workshop on Network and operating systems support for digital audio and video. NOSSDAV '09, New York 2009.
41. Graubner M, Mogre PS, Steinmetz R, Lorenzen T: A new QoE model and evaluation method for broadcast audio contribution over IP. [http://doi.acm.org/10.1145/1806565.1806581]Internatio nal workshop on Network and operating systems support for digital audio and video. NOSSDAV '10, New York 2010.
42. Chen KT, Wu CC, Chang YC, Lei CL: A crowdsourceable QoE evaluation framework for multimedia content. [http://doi.acm.org/10.1145/1631272.1631339]ACM international conference on Multimedia. MM '09, New York 2009.
43. Baset SA, Schulzrinne HG: An analysis of the skype peer-to-peer internet telephony protocol.IEEE International Conference on, Computer Communications 2006.
44. Bonfiglio D, Mellia M, Meo M, Rossi D, Tofanelli P: Revealing skype traffic: when randomness plays with you. [http://doi.acm.org/10.1145/1282380.1282386]Proceedings of the 2007 conference on Applications, technologies, architectures, and protocols for computer communications. SIGCOMM '07, New York 2007.
45. Falk T, Chan WY: Single-Ended speech quality measurement using machine learning methods.Audio, Speech, and Language Processing, IEEE Transactions on 2006.,14(6):
46. Rix A, Beerends J, Kim DS, Kroon P, Ghitza O: Objective assessment of speech and audio quality - technology and applications.IEEE Trans Audio Speech Language Process 2006.,14(6):
47. Eyben F, Wöllmer M, Schuller B: OpenSMILE: the munich versatile and fast open-source audio feature extractor. [http://doi.acm.org/10.1145/1873951.1874246]ACM international conference on Multimedia. MM '10, New York 2010.
48. Gorin A, Levinson S, Miller L, Gertner A, Ljolje A, Goldman E: On adaptive acquisition of language.Acoustics, Speech, and Signal Processing, 1990. ICASSP-90., 1990 International Conference on 1990., 1:
49. Woodland P, Odell J, Valtchev V, Young S: Large vocabulary continuous speech recognition using HTK.Acoustics, Speech, and Signal Processing, 1994. ICASSP-94., 1994 IEEE International Conference on, Volume ii. II/125 -II/128 1994., 2:
50. Vertanen K: Baseline wsj acoustic models for htk and sphinx: training recipes and recognition experiments.
51. English gigaword linguistic data consortium, Philadelphia [http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2003T05]
52. Ang J, Dhillon R, Krupski A, Shriberg E, Stolcke A: Prosody-based automatic detection of annoyance and frustration in human-computer dialog.ICSLP 2002.
53. Interactions ICM, Arunachalam S, Gould D, Andersen E, Byrd D, Narayanan S: Politeness and frustration language.Eurospeech 2001.
54. Kittler J, Hatef M, Duin R, Matas J: On Combining Classifiers.IEEE Transactions on Pattern Analysis and Machine Intelligence 1998.,20(3):
55. Tax DMJ, van Breukelen M, Duin RPW, Kittler J: Combining multiple classifiers by averaging or by multiplying? [http://www.sciencedirect.com/science/article/B6V14-40961WK-7/2/9624dda26ddc086458febdde9f819862]Pattern Recognit 2000.,33(9):
56. Chang CC, Lin CJ: LIBSVM: a library for support vector machines. [http://www.csie.ntu.edu.tw/cjlin/libsvm]
57. Rizzo L: Dummynet: a simple approach to the evaluation of network protocols. [http://doi.acm.org/10.1145/251007.251012]SIGCOMM Comput Commun Rev 1997., 27:
58. PortAudio: Portable Cross-Platform Audio I/O [http://www.portaudio.com]
59. PJSIP: Open source SIP stack and media stack for presence, instant messaging, and multimedia communication [http://www.pjsip.org]
60. Gray P, Massara R, Hollier M: An experimental investigation of the accumulation of perceived error in time-varying speech distortions. [http://www.aes.org/e-lib/browse.cfm?elib=7191]Audio Engineering Society Convention 1997., 103:
61. Rosenbluth JH: Testing the quality of connections having time varing impairments.ITU-T del cont COM12-D64 1998.
62. Woodruff A, Aoki PM: Conversation analysis and the user experience.ACM SIGCHI workshop on exploring experience methods across disciplines 2004.
63. ITU: ITU-T Rec. BS.1284–1: General methods for the subjective assessment of sound quality.Geneva 2003.
64. CMU pronounciation dictionary [http://www.speech.cs.cmu.edu/cgi-bin/cmudict]
65. Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH: The WEKA data mining software: an update. [http://doi.acm.org/10.1145/1656274.1656278]SIGKDD Explor Newsl 2009., 11: