Inferring colocation and conversation networks from privacy-sensitive audio with implications for computational social science

ACM Transactions on Intelligent Systems and Technology

Volumn 2, Issue 1, 2011, Pages

  Wyatt, Danny ^a   Choudhury, Tanzeem ^b   Bilmes, Jeff ^a   Kitts, James A ^c  

^a University of Washington   (United States)

^b DARTMOUTH COLLEGE   (United States)

^c Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Mobile sensing; Social networks

Indexed keywords

BEHAVIORAL DATA; COLOCATIONS; COMPUTATIONAL SOCIAL SCIENCE; FACE-TO-FACE INTERACTION; GRADUATE SCHOOLS; HUMAN BEHAVIORS; MOBILE SENSING; NEW TECHNOLOGIES; RESEARCH QUESTIONS; SOCIAL INTERACTIONS; SOCIAL NETWORKS;

ENGINEERING RESEARCH; SOCIAL NETWORKING (ONLINE); SOCIAL SCIENCES COMPUTING; STUDENTS; TEACHING; WIRELESS NETWORKS;

BEHAVIORAL RESEARCH;

EID: 79955150614     PISSN: 21576904     EISSN: 21576912     Source Type: Journal    
DOI: 10.1145/1889681.1889688     Document Type: Article

References (57)

1. Ajmera, J., Lathoud, G., and McCowan, I. 2004. Clustering and segmenting speakers and their locations in meetings. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
2. Ang, J. 2002. Prosody-based automatic detection of annoyance and frustration in humancomputer dialog. In Proceedings of the International Conference on Spoken Language Processing (ICSLP).
3. Anguera, X. 2006. Robust speaker diarization for meetings. Ph.D. dissertation, Universitat Politècnica de Catalunya.
4. Basu, S. 2002. Conversational scene analysis. Ph.D. dissertation, Massachusetts Institute of Technology.
5. Basu, S. 2003. A linked-HMM model for robust voicing and speech detection. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
6. Batliner, A., Fisher, K., Huber, R., Spilker, J., and Nöth, E. 2000. Desperately seeking emotions or: actors, wizards and human beings. In Proceeding of the ISCA Tutorial and Research Workshop on Speech and Emotion.
7. Baym, N., Zhang, Y.B., and Lin, M. C. 2004. Social interactions across media: Interpersonal communication on the internet, telephone and face-to-face. New Media Society 6, 299-318. (Pubitemid 38773600)
8. Bernard, H. R. and Killworth, P. D. 1977. Informant accuracy in social networks II. Hum. Comm. Resear. 4, 1, 3-18.
9. Bernard, H.R., Killworth, P.D., and Sailer, L. 1980. Informant accuracy in social network data IV: a comparison of clique-level structure in behavioral and cognitive network data. Social Netw. 2, 3, 191-218.
10. Bernard, H.R., Killworth, P.D., and Sailer, L. 1982. Informant accuracy in social network data V: An experimental attempt to predict actual communication from recall data. Social Sci. Resear. 11, 30-66.
11. Bilmes, J. 2004. On soft evidence in bayesian networks. Tech. rep. 16, Department of Electrical Engineering, University of Washingon.
12. Borovoy, R. 2002. Folk computing: Designing technology to support face-to-face community building. Ph.D. dissertation, MIT MediaLab.
13. Campbell, N. 2002. The recording of emotional speech: JST/CREST database research. In Proceedings ofthe Annual Conference on Language Resources and Evaluation (LREC).
14. Choudhury, T. 2004. Sensing and modeling human networks. Ph.D. dissertation, MIT Media Lab.
15. Choudhury, T. and Pentland, A. S. 2003. Sensing and modeling human networks using the sociometer. In Proceedings of the International Conference on Wearable Computing.
16. Connolly, C. I., Burns, J. B., and Bui, H. H. 2008. Recovering social networks from massive track datasets. In Proceedings ofthe IEEE Workshop on Applications ofComputer Vision.
17. Corman, S. R. and Scott, C. R. 1994. A synchronous digital signal processing method for detecting face-to-face organizational communication behavior. Social Netw. 16, 2, 163-179.
18. Davis, J. A. 1970. Clustering and hierarchy in interpersonal relations: Testing two graph theoretical models on 742 sociomatrices. Amer. Socio. Rev. 35, 5, 843-851.
19. Dellaert, F., Polzin, T., and Waibel, A. 1996. Recognizing emotion in speech. In Proceedings of the International Conference on Spoken Language Processing (ICSLP).
20. Dielmann, A. and Renals, S. 2004. Multi-stream segmentation of meetings. In Proceedings of the IEEE Workshop on Multimedia Signal Processing.
21. Donovan, R. 1996. Trainable speech synthesis. Ph.D. dissertation, Cambridge University.
22. Douglas-Cowie, E., Campbell, N., Cowie, R., and Roach, P. 2003. Emotional speech: Towards a new generation of databases. Speech Comm. 40, 33-60.
23. Douglas-Cowie, E., Cowie, R., and Schroeder, M. 2000. A new emotion database: considerations, sources and scope. In Proceedings of the ISCA Tutorial and Research Workshop on Speech and Emotion.
24. Eagle, N. and Pentland, A. S. 2006. Reality mining: Sensing complex social systems. Person. Ubiq. Comput. 10, 4, 255-268.
25. Ferris, B., Haehnel, D., and Fox, D. 2006. Gaussian processes for signal strength-based location estimation. In Proceedings of Robotics: Science and Systems.
26. Freeman, L. 1992. Filling in the blanks: A theory of cognitive categories and the structure of social affiliation. Social Psych. Quart. 55, 2, 118-127.
27. Freeman, L., Romney, A. K., and Freeman, S. C. 1987. Cognitive structure and informant accuracy. Amer. Anthropol. 89, 311-325.
28. Gatica-Perez, D., McCowan, I., Zhang, D., and Bengio, S. 2005. Detecting group interest-level in meetings. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
29. Goodreau, S.M., Kitts, J.A., and Morris, M. 2009. Birds of a feather or friend of a friend? Using exponential random graph models to investigate adolescent social networks. Demography 46, 103-125.
30. Gray, R. M. and Davisson, L. D. 2004. An Introduction to Statistical Signal Processing. Cambridge University Press.
31. Greasley, P., Setter, J., Waterman, M., Sherrard, C., Roach, P., Arnfield, S., and Horton, D. 1995. Representation of prosodic and emotional features in a spoken language database. In Proceedings of the International Congress of Phonetic Sciences.
32. Hawkins, K. 1991. Some consequences of deep interruption in task-oriented communication. J.Lang. Social Psych. 10, 185-203.
33. Holland, P.W. and Leinhardt, S. 1975. The statistical analysis of local structure in social networks. In Sociological Methodology, Jossey-Bass, 1-45.
34. Hurlburt, R., Koch, M., and Heavey, C. 2002. Descriptive experience sampling demonstrates the connection of thinking to externally observable behavior. Cogn. Therapy Res. 26, 1, 117-134. (Pubitemid 39550046)
35. Ingram, P. and Morris, M. 2007. Do people mix at mixers? Structure, homophily, and the "life of the party". Adminis. Sci. Quarter. 52, 4, 558-585.
36. Kampstra, P. 2008. Beanplot: A boxplot alternative for visual comparison of distributions. J. Stat. Softw. 28, 1, 1-9.
37. Killworth, P.D. and Bernard, H. R. 1976. Informant accuracy in social network data. Human Org. 35, 3, 269-286.
38. Killworth, P.D. and Bernard, H. R. 1979. Informant accuracy in social netw. data: III a comparison of triadic structure in behavioral and cognitive datasets. Social Netw. 2, 10-46.
39. Kossinets, G. and Watts, D. J. 2006. Empirical analysis of an evolving social network. Science 311, 88-90. (Pubitemid 43063064)
40. Lazega, E. and van Duijn, M. 1997. Position in formal structure, personal characteristics and choices of advisors in a law firm: A logistic regression model for dyadic network data. Social Netw. 19, 375-397. (Pubitemid 127166668)
41. Leskovec, J., Lang, K.J., Dasgupta, A., and Mahoney, M. W. 2008. Statistical properties of community structure in large social and information networks. In Proceedings of the International World Wide Web Conference (WWW).
42. Lester, J., Choudhury, T., Kern, N., Borriello, G., and Hannaford, B. 2005. A hybrid discriminative-generative approach for modeling human activities. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI).
43. Lian, C. and Hsu, J. 2009. Probabilistic models for concurrent chatting activity recognition. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI).
44. McCowan, I., Bengio, S., Gatica-Perez, D., Lathoud, G., Monay, F., Moore, D., Wellner, P., and Bourlard, H. 2003. Modeling human interaction in meetings. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
45. NIST. 2009. NIST rich transcription evaluations. http://www.itl.nist.gov/ iad/mig/tests/rt/2009/index.html.
46. Onnela, J.-P., SarämAki, J., Hyvönen, J., Szabó, G., de Menezes, M.A., Kaski, K., BarabÁsi, A.-L., and KertÉsz, J. 2007. Analysis of a large-scale weighted network of one-to-one human communication. New J. Physics 9, 179.
47. Palla, G., BarabÁsi, A.-L., and Vicsek, T. 2006. Quantifying social group evolution. Nature 446, 664-667. (Pubitemid 46606882)
48. Quatieri, T. 2001. Discrete-Time Speech Signal Processing: Principles and Practice. Prentice Hall.
49. Rabiner, L. 1977. On the use of autocorrelation analysis for pitch detection. IEEE Trans. Acoustics, Speech, Sig. Process 25, 1, 24-33. (Pubitemid 8037639)
50. Rabiner, L. R. 1989. A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77, 2, 257-286.
51. Reynolds, D. A. and Torres-Carrasquillo, P. 2005. Approaches and applications of audio diarization. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
52. SaramÄki, J., KivelÄ, M., Onnela, J.-P., Kaski, K., and KertÉsz, J. 2007. Generalizations of the clustering coefficient to weighted complex networks. Phys. Rev. E 75, 027105, 1-4.
53. Schuller, B., Rigoll, G., and Lang, M. 2004. Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine-belief network architecture. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
54. Stupakov, A., Hanusa, E., Bilmes, J., and Fox, D. 2009. COSINE-A corpus of multi-party conversational speech in noisy environments. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
55. Watts, D. J. and Strogatz, S. H. 1998. Collective dynamics of' small-world' networks. Nature 393, 440-442.
56. Wren, C.R., Ivanov, Y.A., Leigh, D., and Westhues, J. 2007. The MERL motion detector dataset. Tech. Rep. 2007-069, MERL.
57. Wyatt, D., Choudhury, T., and Bilmes, J. 2007. Conversation detection and speaker segmentation in privacy-sensitive situated speech data. In Proceedings of Interspeech.