The interrogator as critic: The turing test and the evaluation of generative music systems

Computer Music Journal

Volumn 33, Issue 2, 2009, Pages 48-70

  Ariza, Christopher ^a  

^a TOWSON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER INTERFACES; DIGITAL AUDIO; NATURAL LANGUAGES; TURING TESTS;

INTERFACES (COMPUTER); LAW ENFORCEMENT; TOY MANUFACTURE;

TESTING;

EID: 72449146200     PISSN: 01489267     EISSN: 15315169     Source Type: Journal    
DOI: 10.1162/comj.2009.33.2.48     Document Type: Article

References (114)

1. Anonymous. 1998. "A Mega Success, Thanks to You." Telegraph 26 March.
2. Anonymous. 2000. "Are You Smarter Than a Robot." Telegraph 9 March.
3. Ariza, C. 2005. "Navigating the Landscape of Computer- Aided Algorithmic Composition Systems: A Definition, Seven Descriptors, and a Lexicon of Systems and Research." Proceedings of the International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 765-772.
4. Aucouturier, J., and F. Pachet. 2003. "Representing Musical Genre: A State of the Art." Journal of New Music Research 32(1):83-93.
5. Bedworth, J., and J. Norwood. 1999. "The Turing Test is Dead." Proceedings of the 3rd Conference on Creativity & Cognition. New York: Association for Computing Machinery, pp. 193-194.
6. Belgum, E., et al. 1988. "A Turing Test for 'Musical Intelligence'?" Computer Music Journal 12(4):7-9.
7. Block, N. 1981. "Psychologism and Behaviorism." Philosphical Review 90(1):5-43.
8. Bloomfield, B. P., and T. Vurdubakis. 2003. "Imitation Games: Turing, Menard, Van Meegeren." Ethics and Information Technology 5(1):27-38.
9. Boden, M. 1990. The Creative Mind: Myths and Mechanisms. New York: Routledge.
10. Boden, M. A. 1996. "Artificial Genius." Discover 17:104-107.
11. Bringsjord, S., P. Bello, and D. Ferrucci. 2001. "Creativity, the Turing Test, and the (Better) Lovelace Test." Minds and Machines 11:3-27.
12. Bringsjord, S., andD. Ferrucci. 2000. Artificial Intelligence and Literary Creativity: Inside the Mind of BRUTUS, a Storytelling Machine. Mahwah, New Jersey: Lawrence Erlbaum.
13. Bulhak, A. C. 1996. "The Dada Engine." Available online at dev.null.org/dadaengine/manual-1.0/dada-toc.html.
14. Carroll, N. 1999. Philosophy of Art: A Contemporary Introduction. New York: Routledge.
15. Cavell, S. 2002. Must We Mean What We Say?: A Book of Essays. Cambridge, UK: Cambridge University Press.
16. Cohen, H. 2002. "A Self-Defining Game for One Player: On the Nature of Creativity and the Possibility of Creative Computer Programs." Leonardo 35(1):59-64.
17. Collins, N. 2006. "Towards Autonomous Agents for Live Computer Music: Realtime Machine Listening and Interactive Music Systems." PhD dissertation, University of Cambridge.
18. Collins, N. 2008. "Infno: Generating Synth Pop and Electronic Dance Music On Demand." Proceedings of the International Computer Music Conference.San Francisco, California: International Computer Music Association. Available online at www.informatics.sussex.ac.uk/users/nc81/research/infno.pdf.
19. Cook, J. 1994. "Agent Reflection in an Intelligent Learning Environment Architecture for Composition." In M. Smith, A. Smaill and G. A. Wiggins, eds. Music Education: An Artificial Intelligence Approach. London: Springer Verlag, pp. 3-23.
20. Cope, D. 1991. Computers and Musical Style. Oxford: Oxford University Press.
21. Cope, D. 1992. "Computer Modeling of Musical Intelligence in EMI." Computer Music Journal 16(2):69-83.
22. Cope, D. 1996. Experiments in Musical Intelligence. Madison, Wisconsin: A-R Editions.
23. Cope, D. 2000. The Algorithmic Composer.Madison, Wisonsin: A-R Editions.
24. Cope, D. 2001. Virtual Music: Computer Synthesis of Musical Style. Cambridge, Massachusetts: MIT Press.
25. Cope, D. 2005. Computer Models of Musical Creativity. Cambridge, Massachusetts: MIT Press.
26. Copeland, B. J. 2000. "The Turing Test." Minds and Machines 10:519-539.
27. Crockett, L. J. 1994. The Turing Test and the Frame Problem: AI's Mistaken Understanding of Intelligence. Bristol, UK: Intellect.
28. Cross, I. 1993. "The Chinese Music Box." Interface 22:165-172.
29. Dahlig, E., and H. Schaffrath. 1997. "Judgments of Human and Machine Authorship in Real and Artificial Folksongs." Computing in Musicology 11:211-219.
30. Damper, R. I. 2006. "The Logic of Searle's Chinese Room Argument." Minds and Machines 16(2):163-183.
31. Dennett, D. C. 1998. Brainchildren: Essays on Designing Minds. Cambridge, Massachusetts: MIT Press.
32. Fowler, J. W. 1994. "Algorithmic Composition." Computer Music Journal 18(3):8-9.
33. French, R. 1990. "Subcognition and the Limits of the Turing Test." Mind 99(393):53-65.
34. French, R. M. 2000. "The Turing Test: The First 50 Years." Trends in Cognitive Sciences 4(3):115-122.
35. Gardner, M. 1974. "Mathematical Games: The Arts as Combinatorial Mathematics, or, How to Compose Like Mozart with Dice." Scientific American 231(6):132-136.
36. Genova, J. 1994. "Turing's Sexual Guessing Game." Social Epistemology 8:313-326.
37. Greenberg, B. 2001. "Experiments in Musical Intelligence and Bach." In D. Cope, ed. Virtual Music: Computer Synthesis of Musical Style. Cambridge, Massachusetts: MIT Press, pp. 221-236.
38. Hall, M., and L. Smith. 1996. "A Computer Model of Blues Music and Its Evaluation." Journal of the Acoustical Society of America 100(2):1163-1167.
39. Halpern, M. 2006. "The Trouble with the Turing Test." The New Atlantis 11:42-63.
40. Harnad, S. 1991. "Other Bodies, Other Minds: A Machine Incarnation of an Old Philosophical Problem." Minds and Machines 1:43-54.
41. Harnad, S. 2000. "Minds, Machines and Turing." Journal of Logic, Language and Information 9(4):425-445.
42. Hauser, L. 1993. "Searle's Chinese Box: The Chinese Room Argument and Artificial Intelligence." PhD dissertation, Michigan State University.
43. Hauser, L. 1997. "Searle's Chinese Box: Debunking the Chinese Room Argument." Minds and Machines 7:199-226.
44. Hauser, L. 2001. "Look Who's Moving the Goal Posts Now." Minds and Machines 11:41-51.
45. Havass, M. 1964. "A Simulation of Music Composition. Synthetically Composed Folkmusic." In F. Kiefer, ed. Computational Linguistics. Budapest: Computing Centre of the Hungarian Academy of Sciences 3:107-128.
46. Hedges, S. A. 1978. "Dice Music in the Eighteenth Century." Music and Letters 59(2):180-187.
47. Hiller, L. 1970. "Music Composed with Computers: An Historical Survey." In H. B. Lincoln, ed. The Computer and Music. Ithaca, New York: Cornell University Press, pp. 42-96.
48. Hiraga, R., et al. 2002. "Rencon: Toward a New Evaluation Method for Performance Rendering Systems." Proceedings of the International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 357-360.
49. Hiraga, R., et al. 2004. "Rencon 2004: Turing Test for Musical Expression." Proceedings of the 2004 Conference on New Interface for Musical Expression. New York: Assocation for Computing Machinery, pp. 120-123.
50. Hofstadter, D. R. 1979. Gödel, Escher, Bach: An Eternal Golden Braid. New York: Vintage.
51. Hofstadter, D. R. 1996. Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought. New York: Basic Books.
52. Hofstadter, D. R. 2001. "Staring Emmy Straight in the Eye-and Doing My Best Not to Flinch." In D. Cope, ed. Virtual Music: Computer Synthesis of Musical Style. Cambridge, Massachusetts: MIT Press, pp. 33-82.
53. Holland, S. 2000. "Artificial Intelligence in Music Education: A Critical Review." In E. R. Miranda, ed. Readings in Music and Artificial Intelligence. Amsterdam: Harwood Academic Publishers, pp. 239-274.
54. Hsu, F. 2002. Behind Deep Blue: Building the Computer that Defeated the World Chess Champion. Princeton, NJ: Princeton University Press.
55. Jefferson, G. 1949. "The Mind of Mechanical Man." British Medical Journal 1:1105-1110.
56. Kant, I. 1790. Kritik der Urteilskraft [Critique of Judgment.] Berlin: Lagarde and Friederich.
57. Kugel, P. 2002. "Computers Can't Be Intelligent (⋯ and Turing Said So)." Minds and Machines 12(4):563-579.
58. Kurzweil, R. 1990. The Age of Intelligent Machines. Cambridge, Massachusetts: MIT Press.
59. Kurzweil, R. 1999. The Age of Spiritual Machines.New York: Penguin Books.
60. Kurzweil, R. 2002. "A Wager on the Turing Test: Why I Think I Will Win." Available online at www.kurzweilai.net/articles/art0374.html? printable=1.
61. Kurzweil, R. 2005. The Singularity is Near.NewYork: Penguin Books.
62. Lamb, G. M. 2006. "Robo-Music Gives Musicians the Jitters." The Christian Science Monitor, December 14.
63. Loebner, H. 1994. "In Response." Communications of the ACM 37(6):79-82.
64. Long Bets Foundation. 2002. "By 2029 No Computer-or 'Machine Intelligence'-Will Have Passed the Turing Test." Available online at www.longbets.org/1.
65. Lovelace, A. 1842. "Translator's Notes to an Article on Babbage's Analytical Engine." In R. Taylor, ed. Scientific Memoirs: Selected from the Transactions of Foreign Academies of Science and Learned Societies, and from Foreign Journals. London: printed by Richard and John E. Taylor, 3:691-731.
66. Loy, D. G. 1991. "Connectionism and Musiconomy." Proceedings of the International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 364-374.
67. Marsden, A. 2000. "Music, Intelligence and Artificiality." In E. R. Miranda, ed. Readings in Music and Artificial Intelligence. Amsterdam: Harwood Academic Publishers, pp. 15-28.
68. Midgette, A. 2005. "Play It Again, Vladimir (via Computer)." New York Times, 5 June.
69. Moor, J. H. 1976. "An Analysis of the Turing Test." Philosophical Studies 30:249-257.
70. Moor, J. H. 2001. "The Status and Future of the Turing Test." Minds and Machines 11:77-93.
71. Mostow, J., and C. Rich. 1998. "The Fifteenth National Conference on Artificial Intelligence." Available online at www.aaai.org/Conferences/ AAAI/aaai98.php.
72. Naor, M. 1996. "Verification of a Human in the Loop or Identification via the Turing Test." Unpublished manuscript.
73. Nelson, S. R. 2006. Steel Drivin Man: John Henry: The Untold Story of an American Legend. Oxford: Oxford University Press.
74. Pachet, F. 2002. "The Continuator: Musical Interaction with Style." Proceedings of the International Computer Music Conference. San Francisco, California: International Computer Music Association, pp. 211-218.
75. Pachet, F., and D. Cazaly. 2000. "A Taxonomy of Musical Genres." Actes du congrès RIAO [Recherche d'Information Assistée par Ordinateur] 2000, Content- Based Multimedia Information Access. Paris: Centre des Hautes Etudes Internationales d'Informatique Documentaire, pp. 1238-1246.
76. Papadopoulos, G., and G. Wiggins. 1999. "AI Methods for Algorithmic Composition: A Survey, a Critical View and Future Prospects." In Proceedings of the AISB '99 Symposium on Musical Creativity. Brighton, UK: SSAISB, pp. 110-117.
77. Pearce, M. T. 2005. "The Construction and Evaluation of Statistical Models of Melodic Structure in Music Perception and Composition." PhD dissertation, Department of Computing, City Univesity London.
78. Pearce, M., D. Meredith, and G. Wiggins. 2002. "Motivations and Methodologies for Automation of the Compositional Process." Musicae Scientiae 6(2):119-147.
79. Pearce, M., and G. Wiggins. 2001. "Towards a Framework for the Evaluation of Machine Compositions." Proceedings of the AISB01 Symposium on Artificial Intelligence and Creativity in the Arts and Sciences. Brighton, UK: SSAISB, pp. 22-32.
80. Peña, W. M., and S. A. Parshall. 1987. Problem Seeking: An Architectural Programming Primer,3rded. Washington, DC: AIA Press.
81. Rapaport, W. J. 2000. "How to Pass a Turing Test." Journal of Logic, Language, and Information 9:467-490.
82. Riskin, J. 2003. "The Defecating Duck, or, the Ambiguous Origins of Artificial Life." Critical Inquiry 29(4):599-633.
83. Roads, C. 1984. "An Overview of Music Representations." Musical Grammars and Computer Analysis. Firenze: Leo S. Olschki, pp. 7-37.
84. Saygin, A. P., I. Cicekli, and V. Akman. 2000. "Turing Test: 50 Years Later." Minds and Machines 10(4):463-518.
85. Scruton, R. 1999. The Aesthetics Of Music. Oxford: Oxford University Press.
86. Searle, J. R. 1980. "Minds, Brains, and Programs." Behavioral and Brain Sciences 3(3):417-457.
87. Searle, J. R. 1993. "The Failures of Computationalism." Think 2:12-78.
88. Shieber, S. M. 1993. "Lessons from a Restricted Turing Test." Communications of the ACM 37(6):70-78.
89. Silva, P. 2003. David Cope and Experiments in Musical Intelligence. Los Angeles, California: Spectrum Press.
90. Soldier, D. 2002. "Eine Kleine Naughtmusik: How Nefarious Nonartists Cleverly Imitate Music." Leonardo Music Journal 12:53-58.
91. Solis, J., et al. 2006. "The Waseda Flutist Robot WF-4RII in Comparison with a Professional Flutist." Computer Music Journal 30(4):12-27. (Pubitemid 44911406)
92. Soltau, H., et al. 1998. "Recognition of Music Types." Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2:1137-1140.
93. Sony Computer Science Laboratory. 2002. "A Musical Turing Test." Sony Computer Science Laboratory. Available online at www.csl.sony.fr/-pachet/Continuator/VPRO/VPRO.htm.
94. Standage, T. 2002. The Turk.NewYork:Walkerand Company.
95. Sterrett, S. G. 2000. "Turing's Two Tests for Intelligence." Minds and Machines 10:541-559.
96. Sussman, M. 1999. "Performing the Intelligent Machine: Deception and Enchantment in the Life of the Automaton Chess Player." The Drama Review 43(3):81-96.
97. Terzidis, K. 2006. Algorithmic Architecture. Oxford: Architectural Press.
98. Trivino-Rodriguez, J. L., and R. Morales-Bueno. 2001. "Using Multiattribute Prediction Suffix Graphs to Predict and Generate Music." Computer Music Journal 25(3):62-79.
99. Turing, A. M. 1939. "Systems of Logic Defined by Ordinals." Procedings of the London Mathematical Society 45:161-228.
100. Turing, A. M. 1950. "Computing Machinery and Intelligence." Mind 59:433-460.
101. von Ahn, L., et al. 2003. "CAPTCHA: Using Hard AI Problems for Security." Advances in Cryptology-Eurocrypt 2003. Santa Barbara, California: International Association for Cryptologic Research, pp. 294-311.
102. von Ahn, L., M. Blum, and J. Langford. 2004. "Telling Humans and Computers Apart Automatically: How Lazy Cryptographers do AI." Communications of the ACM 47(2):56-60.
103. Wakefield, J. C. 2003. "The Chinese Room Argument Reconsidered: Essentialism, Indeterminacy, and Strong AI." Minds and Machines 13:285-319.
104. Wassermann, K. C., et al. 2003. "Live Soundscape Composition Based on Synthetic Emotions." IEEE MultiMedia 10(4):82-90.
105. Weinberg, G., and S. Driscoll. 2006. "Toward Robotic Musicianship." Computer Music Journal 30(4):28-45.
106. Weizenbaum, J. 1966. "ELIZA-A Computer Program For the Study of Natural Language Communication Between Man And Machine." Communications of the ACM 9(1):36-45.
107. Wiggins, G. A. 2006. "A Preliminary Framework for Description, Analysis and Comparison of Creative Systems." Knowledge-Based Systems 19:449-458.
108. Wiggins, G., and A. Smaill. 2000. "Musical Knowledge: What Can Artificial Intelligence Bring to the Musician." In E. R. Miranda, ed. Readings in Music and Artificial Intelligence. Amsterdam: Harwood Academic Publishers, pp. 29-46.
109. Wimsatt, W. K. 1954. The Verbal Icon: Studies in the Meaning of Poetry. Louisville, Kentucky: University Press of Kentucky.
110. Wimsatt, W. K., and M. C. Beardsley. 1946. "The Intentional Fallacy." Sewanee Review 54:468-488.
111. Xenakis, I. 1985. "Music Composition Treks." In C. Roads, ed. Composers and the Computer.LosAltos, California: William Kaufmann.
112. Zdenek, S. 2001. "Passing Loebner's Turing Test: A Case of Conflicting Discourse Functions." Minds and Machines 11:53-76.
113. Zimmerman, R. L. 1966. "Can Anything Be an Aesthetic Object." The Journal of Aesthetics and Art Criticism 25(2):177-186.
114. Zorn, J. 2000. "Preface." In J. Zorn, ed. Arcana: Musicians on Music. New York: Granary, pp. v-vi.