Predicting continuous conflict perceptionwith bayesian gaussian processes

IEEE Transactions on Affective Computing

Volumn 5, Issue 2, 2014, Pages 187-200

  Kim, Samuel ^a   Valente, Fabio ^a   Filippone, Maurizio ^b   Vinciarelli, Alessandro ^b  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

automatic relevance determination; conflict; Gaussian processes; Social signal processing

Indexed keywords

GAUSSIAN DISTRIBUTION; SIGNAL PROCESSING;

AUTOMATIC RELEVANCE DETERMINATION; BAYESIAN GAUSSIAN PROCESS; COMPUTING COMMUNITY; CONFLICT; GAUSSIAN PROCESSES; HUMAN OBSERVERS; POLITICAL DEBATES; SOCIAL SIGNAL PROCESSING;

GAUSSIAN NOISE (ELECTRONIC);

EID: 84905709042     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAFFC.2014.2324564     Document Type: Article

References (67)

1. J. M. Levine and R. L. Moreland, "Small groups," in The Handbook of Social Psychology, D. Gilbert and G. Lindzey, Eds. London, U.K.: Oxford Univ. Press, 1998, vol. 2, pp. 415-469.
2. P. Spector and S. Jex, "Development of four self-report measures of job stressors and strain: Interpersonal conflict at work scale, organizational constraints scale, quantitative workload inventory, and physical symptoms inventory," J. Occup. Health Psychol., vol. 3, no. 4, pp. 356-367, 1998.
3. J. Gottman, H. Markman, and C. Notarius, "The topography of marital conflict: A sequential analysis of verbal and nonverbal behavior," J. Marriage Family, vol. 39, no. 3, pp. 461-477, 1977. (Pubitemid 8166174)
4. R. Baumeister, A. Stillwell, and S. Wotman, "Victim and perpetrator accounts of interpersonal conflict: Autobiographical narratives about anger," J. Personality Social Psychol., vol. 59, no. 5, pp. 994-1005, 1990.
5. A. Vinciarelli, M. Pantic, and H. Bourlard, "Social signal processing: Survey of an emerging domain," Image Vis. Comput. J., vol. 27, no. 12, pp. 1743-1759, 2009.
6. A. Vinciarelli, M. Pantic, D. Heylen, C. Pelachaud, I. Poggi, F. D'Errico, and M. Schroeder, "Bridging the gap between social animal and unsocial machine: A survey of social signal processing," IEEE Trans. Affect. Comput., vol. 3, no. 1, pp. 69-87, Jan.-Mar. 2012.
7. S. Kim, F. Valente, and A. Vinciarelli, "Automatic detection of conflicts in spoken conversations: Ratings and analysis of broadcast political debates," in Proc. IEEE Int. Conf. Acoustics, Speech Signal Process., 2012, pp. 5089-5092.
8. S. Renals, H. Bourlard, J. Carletta, and A. Popescu-Belis, Eds., Multimodal Signal Processing: Human Interactions in Meetings. Cambridge, U.K.: Cambridge Univ. Press, 2012.
9. T. Fong, I. Nourbakhsh, and K. Dautenhahn, "A survey of socially interactive robots," Robot. Autonom. Syst., vol. 42, no. 3, pp. 143-166, 2003.
10. D. Mutz and B. Reeves, "The new videomalaise: Effects of televised incivility on political trust," Amer. Political Sci. Rev., vol. 99, no. 1, pp. 1-15, 2005.
11. C. Reinemann and M. Maurer, "Unifying or polarizing? shortterm effects and postdebate consequences of different rhetorical strategies in televised debates," J. Commun., vol. 55, no. 4, pp. 775-794, 2005. (Pubitemid 43118437)
12. W. Arsenio and M. Killen, "Conflict-related emotions during peer disputes," Early Educ. Develop., vol. 7, no. 1, pp. 43-57, 1996.
13. C. Bell and F. Song, "Emotions in the conflict process: An application of the cognitive appraisal model of emotions to conflict management," Int. J. Conflict Manage., vol. 16, no. 1, pp. 30-54, 2005.
14. P. Jordan and A. Torth, "Managing emotions during team problem solving: Emotional intelligence and conflict resolution," Human Perform., vol. 17, no. 2, pp. 195-218, 2004. (Pubitemid 38830392)
15. A. L. Sillars, S. F. Coletti, D. Parry, and M. A. Rogers, "Coding verbal conflict tactics: Nonverbal and perceptual correlates of the 'avoidance-distributive-integrative' distinction," Human Commun. Res., vol. 9, no. 1, pp. 83-95, 1982.
16. V. Cooper, "Participant and observer attribution of affect in interpersonal conflict: An examination of noncontent verbal behavior," J. Nonverbal Behav., vol. 10, no. 2, pp. 134-144, 1986.
17. L. Smith-Lovin and C. Brody, "Interruptions in group discussions: The effects of gender and group composition," Am. Soc. Rev., vol. 54, no. 3, pp. 424-435, 1989.
18. E. Schegloff, "Overlapping talk and the organisation of turntaking for conversation," Language Soc., vol. 29, no. 1, pp. 1-63, 2000.
19. M. Mehu and K. Scherer, "A psycho-ethological approach to social signal processing," Cognit. Process., vol. 13, no. 2, pp. 397-414, 2012.
20. I. Poggi and F. D'Errico, "Social signals: A framework in terms of goals and beliefs," Cognit. Process., vol. 13, no. 2, pp. 427-445, 2012.
21. P. Brunet and R. Cowie, "Towards a conceptual framework of research on social signal processing," J. Multimodal User Interfaces, vol. 6, no. 3/4, pp. 101-115, 2012.
22. F. Metze, A. Batliner, F. Eyben, T. Polzehl, B. Schuller, and S. Steidl, "Emotion recognition using imperfect speech recognition." in Proc. Interspeech, 2010, pp. 478-481.
23. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
24. S. Kim, M. Filippone, F. Valente, and A. Vinciarelli, "Predicting the conflict level in television political debates: An approach based on crowdsourcing, nonverbal communication and Gaussian processes," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 793-796.
25. A. Vehtari and J. Lampinen, "Bayesian input variable selection using posterior probabilities and expected utilities," Helsinki University of Technology, Tech. Rep. B31, 2002.
26. A. Vinciarelli, S. Kim, F. Valente, and H. Salamin, "Collecting data for socially intelligent surveillance and monitoring approaches: The case of conflict in competitive conversations," in Proc. Int. Symp. Commun., Control Signal Process., 2012, pp. 1-4.
27. I. Poggi, F. D'Errico, and L. Vincze, "Agreement and its multimodal communication in debates: A qualitative analysis," Cognit. Comput., vol. 3, no. 3, pp. 466-479, 2011.
28. K. Bousmalis, M. Mehu, and M. Pantic, "Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases and tools," Image Vis. Comput. J., vol. 31, pp. 203-221, 2013.
29. D. Hillard, M. Ostendorf, and E. Shriberg, "Detection of agreement vs. disagreement in meetings: Training with unlabeled data," in Proc. Conf. North Amer. Chapter Assoc. Comput. Linguistics: Human Language Technol., 2003, pp. 34-36.
30. B. Wrede and E. Shriberg, "The relationship between dialogue acts and hot spots in meetings," in Proc. IEEE Speech Recognit. Understanding Workshop, 2003, pp.180-185.
31. B. Wrede and E. Shriberg, "Spotting 'Hotspots' in meetings: Human judgments and prosodic cues," in Proc. Eurospeech, 2003, pp.2805-2808.
32. M. Galley, K. McKeown, J. Hirschberg, and E. Shriberg, "Identifying agreement and disagreement in conversational speech: Use of Bayesian networks to model pragmatic dependencies," in Proc. 42nd Annu. Meet. Assoc. Comput. Linguistics, 2004, p. 669.
33. S. Germesin and T. Wilson, "Agreement detection in multiparty conversation," in Proc. ACM Int. Conf. Multimodal Interfaces, 2009, pp. 7-14.
34. K. Bousmalis, L. P. Morency, and M. Pantic, "Modeling hidden dynamics of multimodal cues for spontaneous agreement and disagreement recognition," in Proc. Face Gesture, 2011, pp. 746-752.
35. A. Vinciarelli, A. Dielmann, S. Favre, and H. Salamin, "Canal9: A database of political debates for analysis of social interactions," in Proc. Int. Conf. Affect. Comput. Intell. Interact., 2009, vol. 2, pp. 96-99.
36. A. Pesarin, M. Cristani, V. Murino, and A. Vinciarelli, "Conversation analysis at work: Detection of conflict in competitive discussions through automatic turn-organization analysis," Cognit. Process., vol. 13, no. 2, pp. 533-540, 2012.
37. F. Grezes, J. Richards, and A. Rosenberg, "Let me finish: Automatic conflict detection using speaker overlap," in Proc. Interspeech, 2013, pp. 200-204.
38. O. Räsänen and J. Pohjalainen, "Random subset feature selection in automatic Recognition of developmental disorders, affective states, and level of conflict from speech," in Proc. Interspeech, 2013, pp. 210-214.
39. P. Georgiou, M. Black, A. Lammert, B. Baucom, and S. Narayanan, "'That's aggravating, very aggravating': Is it possible to classify behaviors in couple interactions using automatically derived lexical features?" in Proc. Int. Conf. Affect. Comput. andIntell. Interaction, 2011, pp. 87-96.
40. A. Perina, M. Cristani, U. Castellani, V. Murino, and N. Jojic, "Free energy score space," in Proc. Adv. Neural Inf. Process. Systems, 2009, pp. 1428-1436.
41. B. Schuller, S. Steidl, A. Batliner, A. Vinciarelli, K. Scherer, F. Ringeval, M. Chetouani, F. Weninger, F. Eyben, E. Marchi, M. Mortillaro, H. Salamin, A. Polychroniou, F. Valente, and S. Kim, "The INTERSPEECH 2013 computational paralinguistics challenge: Social signals, conflict, emotion, autism," presented at the 14th Annu. Conf. Int. Speech Commun. Assoc., Lyon, France, 2013.
42. J. Wall and R. Roberts Callister, "Conflict and its management," J. Manag., vol. 21, no. 3, pp. 515-558, 1995.
43. C. Judd, "Cognitive effects of attitude conflict resolution," J. Conflict Resolution, vol. 22, no. 3, pp. 483-498, 1978.
44. K. Scherer, "Vocal markers of emotion: Comparing induction and acting elicitation," Comput. Speech Language, vol. 27, no. 1, pp. 40-58, 2013.
45. P. Waxer, "Video ethology: Television as a data base for crosscultural studies in nonverbal displays," J. Nonverbal Behav., vol. 9, no. 2, pp. 111-120, 1985.
46. K. Scherer, "Vocal communication of emotion: A review of research paradigms," Speech Commun., vol. 40, no. 1, pp. 227-256, 2003.
47. P. Stewart, F. Salter, and M. Mehu, "Taking leaders at face value: Ethology and the analysis of televised leader displays," Politics Life Sci., vol. 28, no. 1, pp. 48-74, 2009.
48. K. Scherer, "Personal. inference from voice quality: The loud voice of extroversion," Eur. J. Soc. Psychol., vol. 8, no. 4, pp. 467-487, 1978.
49. T. Bänziger and K. Scherer, "Introducing the Geneva multimodal emotion portrayal (GEMEP) corpus," in Blueprint for Affective Computing: A Sourcebook, K. Scherer, T. Bänziger, and E. Roesch, Eds. London, U.K.: Oxford Univ. Press, 2010, pp. 271-294.
50. G. Mohammadi and A. Vinciarelli, "Automatic personality perception: Prediction of trait attribution based on prosodic features," IEEE Trans. Affect. Comput., vol. 3, no. 3, pp. 273-278, Jul.-Sep. 2012.
51. D. Lehman, C. Chiu, and M. Schaller, "Psychology and culture," Annu. Rev. Psychol., pp. 689-714, 2004.
52. R. Rosenthal, "Conducting judgment studies: Some methodological issues," in The New Handbook of Methods in Nonverbal Behavior Research, J. Harrigan, R. Rosenthal, and K. Scherer, Eds. London, U.K.: Oxford Univ. Press, 2005, pp. 199-234.
53. D. Vijayasenan, F. Valente, and H. Bourlard, "An information theoretic approach to speaker diarization of meeting data," IEEE Trans. Audio Speech Language Process., vol. 17, no. 7, pp. 1382-1393, Sep. 2009.
54. K. Boakye, O. Vinyals, and G. Friedland, "Improved overlapped speech handling for speaker diarization," in Proc. Interspeech, 2011, pp. 941-944.
55. P. Boersma, "Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound," Proc. Inst. Phonetic Sci., vol. 17, no. 1193, pp. 97-110, 1993.
56. G. Yule, Pragmatics. London, U.K.: Oxford Univ. Press, 1996.
57. J. Bilmes, "The concept of preference in conversation analysis," Language Soc., vol. 17, pp. 161-181, 1988.
58. M. Rahim, "A measure of styles of handling interpersonal conflict," Acad. Manage. J., vol. 26, no. 2, pp. 368-376, 1983.
59. C. E. Rasmussen and C. Williams, Gaussian Processes for Machine Learning. Cambridge, MA, USA: MIT Press, 2006.
60. M. Filippone, A. Marquand, C. Blain, S. Williams, J. Mour-ao-Miranda, and M. Girolami, "Probabilistic prediction of neurological disorders with a statistical assessment of neuroimaging data modalities," Ann. Appl. Stat., vol. 6, no. 4, pp. 1883-1905, 2012.
61. M. Filippone and M. Girolami, "Pseudo-marginal Bayesian inference for Gaussian processes," IEEE Trans. Pattern Analysis Machine Intell., 2014, to appear. DOI: 10.1109/TPAMI.2014.2316530.
62. C. P. Robert and G. Casella, Monte Carlo Statistical Methods. New York, NY, USA: Springer-Verlag, 2005.
63. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1995.
64. C. Chang and C. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol, vol. 2, no. 3, 2011.
65. A. Gelman and D. Rubin, "Inference from iterative simulation using multiple sequences," Statist. Sci., vol. 7, no. 4, pp. 457-472, 1992.
66. R. Levitan and J. Hirschberg, "Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions" in Proc. Interspeech, 2011, pp. 3081-3084.
67. C. Lee, M. Black, A. Katsamanis, A. Lammert, B. Baucom, A. Christensen, P. Georgiou, and S. Narayanan, "Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples," in Proc. Interspeech, 2010, pp. 793-796.