VocaListener and VocaWatcher: Imitating a human singer by using signal processing

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2012, Pages 5393-5396

  Goto, Masataka ^a   Nakano, Tomoyasu ^a   Kajita, Shuuji ^a   Matsusaka, Yosuke ^a   Nakaoka, Shin'ichiro ^a   Yokoi, Kazuhito ^a  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Music; singing information processing; singing robot; singing synthesis

Indexed keywords

FACIAL MOTIONS; HUMANOID ROBOT; INFORMATION PROCESSING SYSTEMS; INTUITIVE CONTROLS; MUSIC;

ANTHROPOMORPHIC ROBOTS; DATA PROCESSING; DYNAMICS;

SIGNAL PROCESSING;

EID: 84867619250     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2012.6289140     Document Type: Conference Paper

References (26)

1. H. Kenmochi, "VOCALOID and Hatsune Miku phenomenon in Japan," in Proc. of InterSinging 2010, pp. 1-4, 2010.
2. M. Goto et al., "Singing information processing based on singing voice modeling," in Proc. of ICASSP 2010, 2010.
3. T. Nakano andM. Goto, "VocaListener: A singing-to-singing synthesis system based on iterative parameter estimation," in Proc. of SMC 2009, pp. 343-348, 2009.
4. T. Nakano and M. Goto, "VocaListener2: A singing synthesis system able to mimic a user's singing in terms of voice timbre changes as well as pitch and dynamics," in Proc. of ICASSP 2011, pp. 453-456, 2011.
5. S. Kajita et al., "VocaWatcher: Natural singing motion generator for a humanoid robot," in Proc. of IROS 2011, 2011.
6. K. Kaneko et al., "Cybernetic Human HRP-4C," in Proc. of Humanoids 2009, pp. 7-14, 2009.
7. H. Kenmochi and H. Ohshita, "Vocaloid - commercial singing synthesizer based on sample concatenation," in Proc. of Interspeech 2007, pp. 4011-4010, 2007.
8. J. Bonada and X. Serra, "Synthesis of the singing voice by performance sampling and spectral models," IEEE Signal Processing Magazine, vol. 24, no. 2, pp. 67-79, 2007.
9. K. Saino et al., "An HMM-based singing voice synthesis system," in Proc. of Interspeech 2006, pp. 1141-1144, 2006.
10. T. Saitou et al., "Speech-to-singing synthesis: Converting speaking voices to singing voices by controlling acoustic features unique to singing voices," in Proc. of WASPAA 2007, pp. 215-218, 2007.
11. J. Janer, J. Bonada and M. Blaauw, "Performance-driven control for sample-based singing voice synthesis," in Proc. of DAFx-06, pp. 41-44, 2006.
12. T. Toda, A. Black and K. Tokuda, "Voice conversion based on maximum likelihood estimation of spectral parameter trajectory," IEEE Trans. on ASLP, vol. 15, no. 8, pp. 2222-2235, 2007.
13. F. Villavicencio and E. Maestre, "GMM-PCA based speaker-timbre conversion on full-quality speech," in Proc. of SSW-7, pp. 56-61, 2010.
14. O. Türk andM. Schröder, "A comparison of voice conversion methods for transforming voice quality in emotional speech synthesis," in Proc. of Interspeech 2008, pp. 2282-2285, 2008.
15. T. Nose, M. Tachibana and T. Kobayashi, "HMM-based style control for expressive speech synthesis with arbitrary speaker's voice using model adaptation," IEICE Trans. on Information and Systems, vol. E92-D, no. 3, pp. 489-497, 2009.
16. Z. Inanoglu and S. Young, "Data-driven emotion conversion in spoken English," Speech Communication, vol. 51, no. 3, pp. 268-283, 2009.
17. F. Villavicencio and J. Bonada, "Applying voice conversion to concatenative singing-voice synthesis," in Proc. of Interspeech 2010, pp. 2162-2165, 2010.
18. H. Kawahara et al., "Temporally variable multi-aspect auditory morphing enabling extrapolation without objective and perceptual breakdown," in Proc. of ICASSP 2009, pp. 3905-3908, 2009.
19. I. Kato et al., "The robot musician WABOT-2 (Waseda Robot-2)," Robotics, vol. 3, pp. 143-155, 1987.
20. K. Chida et al., "Development of a new anthropomorphic flutist robot WF-4," in Proc. of ICRA 2004, pp. 152-157, 2004.
21. T. Mizumoto et al., "Thereminist robot: Development of a robot theremin player with feedforward and feedback arm control based on a theremin's pitch model," in Proc. of IROS 2009, pp. 2297-2302, 2009.
22. Y. Kuroki et al., "A small biped entertainment robot exploring attractive applications," in Proc. of ICRA 2003, pp. 471-476, 2003.
23. K. Murata et al., "A robot singer with music recognition based on realtime beat tracking," in Proc. of ISMIR 2008, pp. 199-204, 2008.
24. M. Tachibana, S. Nakaoka and H. Kenmochi, "A singing robot realized by a collaboration of VOCALOID and Cybernetic Human HRP-4C," in Proc. of InterSinging 2010, pp. 9-14, 2010.
25. F. Wilbers, C. Ishi and H. Ishiguro, "A blendshape model for mapping facial motions to an android," in Proc. of IROS 2007, pp. 542-547, 2007.
26. P. Jaeckel, N. Campbell and C. Melhuish, "Facial behavior mapping -from video footage to a robot head," Robotics and Autonomous Systems, vol. 56, pp. 1042-1049, 2008.