VoiceLabel: Using speech to label mobile sensor data

ICMI'08: Proceedings of the 10th International Conference on Multimodal Interfaces

Volumn , Issue , 2008, Pages 69-76

  Harada, Susumu ^a   Lester, Jonathan ^a   Patel, Kayur ^a   Saponas, T Scott ^a   Fogarty, James ^a   Landay, James A ^a,b   Wobbrock, Jacob O ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b INTEL CORPORATION   (United States)

Author keywords

Data collection; Machine learning; Mobile devices; Sensors; Speech recognition

Indexed keywords

ALTERNATIVE APPROACHES; AUDIO STREAMS; DATA COLLECTION; DATA COLLECTION TOOLS; DATA LABELING; DATA LABELS; KEY FEATURES; MACHINE LEARNING; MOBILE MACHINES; MOBILE SENSORS; MULTI-MODAL INTERFACES; OFFLINE; SENSOR DATUM; TWO COMPONENTS;

DATA ACQUISITION; INTERACTIVE COMPUTER SYSTEMS; LABELS; MOBILE COMPUTING; MOBILE DEVICES; PORTABLE EQUIPMENT; ROBOT LEARNING; SENSORS; SPEECH ANALYSIS;

SPEECH RECOGNITION;

EID: 63449125650     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452392.1452407     Document Type: Conference Paper

References (17)

1. Bao, L. and Intille, S. S. 2004. Activity recognition from user-annotated acceleration data. In Proc. of Pervasive 2004.
2. Basu, S., Clarkson, B., and Pentland, A. 2001. Smart headphones: enhancing auditory awareness through robust speech detection and source localization. In Proc. Of ICASSP 2001.
3. Bilmes, J., Li, X., Malkin, J., Kilanski, K., Wright, R., Kirchhoff, K., Subramanya, A., Harada, S., Landay, J., Dowden, P., Chizeck, H. 2005. The Vocal Joystick: A voicebased human-computer interface for individuals with motor impairments. In Proc. of HLT/EMNLP 2005.
4. Chen, M, Sohn, T., Chmelev, D., Haehnel, D., Hightower, J., Hughes, J., and LaMarca, A. 2006. Practical metropolitanscale positioning for GSM phones. In Proc. of Ubicomp 2006.
5. Chen, S., Gaur, A., Muthukrishnan, S., and Rosenbluth, D. 2004. Wireless in loco sensor data collection and applications. In Proc. of WWW 2004 Workshop on Emerging Applications for Wireless and Mobile Access.
6. Consolvo, S., McDonald, D., Toscos, T., Chen, M., Froehlich, J., Harrison, B., Klasnja, P., LaMarca, A., LeGrand, L., Libby, R., Smith, I., and Landay, J. 2008. Activity sensing in the wild: a field trial of UbiFit garden. In Proc. of CHI 2008.
7. Fontaine, V., and Bourlard, H. 1997. Speaker-dependent speech recognition based on phone-like units models - application to voice dialing. In Proc. of ICASSP 1997.
8. Goto, M., Itou, K., and Kobayashi, T. 2005. Speech interface exploiting intentionally-controlled nonverbal speech information. In Proc. of UIST 2005.
9. Hill, J., Szewczyk, R., Woo, A., Hollar, S., and Pister, D.C.K. 2000. System architecture directions for networked sensors. In Proc. of ASPLOS 2000.
10. Lamming, M., and Bohm, D. 2003. SPECs: Another approach to human context and activity sensing research, using tiny peer-to-peer wireless computers. In Proc. Of Ubicomp 2003.
11. Lester, J., Choudhury, T., Kern, N., Borriello, G., and Hannaford, B. 2005. A hybrid discriminative-generative approach for modeling human activities. In Proc. of IJCAI 2005.
12. Lester, J., Choudhury, T., and Borriello, G. 2006. A practical approach to recognizing physical activities. In Proc. Of Pervasive 2006.
13. Logan, B., Healey, J., Philipose, M., Tapia, E.M., and Intille, S. 2007. A long-term evaluation of sensing modalities for activity recognition. In Proc. of Ubicomp 2007.
14. Nissenbaum, H. 1998. Protecting privacy in an information age: The problem of privacy in public. In Law and Philosophy 17 (5-6).
15. Shilman, M., Tan, D., and Simard, P., 2006. CueTIP: A mixed-initiative interface for correcting handwriting errors. In Proc. of UIST 2006.
16. Saponas, T., Lester, J., Froehlich, J, Fogarty, J., Landay, J. 2008. iLearn on the iPhone: Real-Time Human Activity Classification on Commodity Mobile Phones. University of Washington CSE Tech Report UW-CSE-08-04-02.
17. Tapia, E.M., Intille, S.S., and Larson, K. 2004. Activity recognition in the home setting using simple and ubiquitous sensors. In Proc. of Pervasive 2004.