Can computers deliberately deceive? A simulation tool and its application to turing's imitation game

Computational Intelligence

Volumn 19, Issue 3, 2003, Pages 235-263

  De Rosis, Fiorella ^a   Carofiglio, Valeria ^a   Grassano, Giuseppe ^a   Castelfranchi, Cristiano ^b  

^a UNIVERSITY OF BARI   (Italy)

^b UNIVERSITY OF SIENA   (Italy)

Author keywords

Belief ascription; Belief networks; Deception modeling; Uncertain reasoning

Indexed keywords

COMPUTER SIMULATION; HUMAN COMPUTER INTERACTION; MULTI AGENT SYSTEMS; SECURITY OF DATA; TURING MACHINES;

BELIEF NETWORKS; DECEPTION MODELING; UNCERTAIN REASONING;

GAME THEORY;

EID: 0345015442     PISSN: 08247935     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-8640.00223     Document Type: Article

References (48)

1. BARNETT, J. A. 1991. Calculating dempster-shafer plausibility. IEEE Transactions on Pattern Analysis and Machine Intelligence. 13:6.
2. BERRY, D., I. MICHAS, T. GILLIE, and S. FOSTER. 1998. What do patients want to know about their medicines and what do doctors want to tell them? A comparative study. Psychology and Health, 12:467-480.
3. BRODY, H. 1982. The lie that heals; the ethics of giving placebos. Annals of Internal Medicine, 97.
4. BULLER, D. B., J. K. BURGOON, A. BUSLIG, and J. ROIGER. 1996. Testing interpersonal deception theory; the language of interpersonal deception. Communication Theory, 6:3.
5. BURGOON, J. K., D. B. BULLER, K. FLOYD, and J. GRANDPRE. 1996. Deceptive realities. Communication Research, 23:6.
6. CARBERRY, S., and L. LAMBERT. 1999. A process model for recognising communicative acts and modeling negotiation subdialogs. Computational Linguistics, 25.
7. CAROFIGLIO, V., and F.DE ROSIS. 2001a. Ascribing and weighting beliefs in deceptive information exchanges. In User Modeling 2001, LNAI2109. pp. 222-224. Edited by M. Bauer, P. J. Gmytrasiewicz, and J. Vassileva. Springer:222-224.
8. CAROFIGLIO, V., and F.DE ROSIS. 2001b. Exploiting uncertainty and incomplete knowledge in deceptive argumentation. In Computational Science - ICCS 2001, LNCS 2073. Editors by V. N. Alexandrov, J. J. Dongarra, B. A. Juliano, R. S. Renner, and C. J. K. Tan. 1019-1028. Springer.
9. CAROFIGLIO, V., F.DE ROSIS, and R. GRASSANO. 2001c. An interactive system for generating arguments in deceptive communication. In AI*IA 2001: Advances in Artificial Intelligence, LNAI 2175, 255-266. Edited by F. Esposito. Springer.
10. CASTELFRANCHI, C., and I. POGGI. 1993. Lying as pretending to give information. Pretending to Communicate. Edited by H. Parret. Springer Verlag.
11. CASTELFRANCHI, C., and I. POGGI. 1998. Bugie, finzioni e sotterfugi. Carocci Publ Co.
12. C. CASTELFRANCHI, F.DE ROSIS, and F. GRASSO. 1999. Deception and suspicion in medical interactions; towards the simulation of believable dialogues. In Machine Conversations. Edited by Y. Wilks. Kluwer Academic Publishers.
13. CASTELFRANCHI, C., R. FALCONE, and F.DE ROSIS. 2001. Deceiving in GOLEM: how to strategically pilfer help. In Trust and deception in virtual societies. Edited by C. Castelfranchi and J-H Tan. Kluwer Academic Publishers, pp. 111-124.
14. COHEN, P. R., and H. J. LEVESQUE. 1992. Persistence, intention and commitment. Intentions in Communication. Edited by P. R. Cohen, J. Morgan, and M. A. Pollack. M. I. T. Press, 33-69.
15. CONATI, C., A. GERTNER, and K. VANLEHN. 2002. Using bayesian networks to manage uncertainty in student modeling. User Modeling and User-Adapted Interaction. 12(4):371-417.
16. DEMOLOMBE, R., and A. JONES. 1996. Modal-logical specification of Security Requirements. FAPR '96 Tutorial.
17. DEMOLOMBE, R. 2001. To trust information sources; a proposal for a modal logic framework. In Trust and Deception in Virtual Societies, pp. 111-124. Edited by C. Castelfranchi, and J-H Tan. Kluwer Academic Publishers, Dordrecht, Boston, London.
18. DE ROSIS, F., F. GRASSO, and D. BERRY. 1999. Refining instructional text generation after evaluation. Artificial Intelligence in Medicine, 17.
19. DE ROSIS F., C. CASTELFRANCHI, and CAROFIGLIO. 2000. On various sources of uncertainty in modeling suspicion and how to treat them. Workshop on Deception, Fraud and Trust in Agent Societies. Autonomous Agents, 61-72.
20. DE ROSIS, F., C. PELACHAUD, I. POGGI, V. CAROFIGLIO, and B. DE CAROLIS. 2003. From Greta's mind to her face. Modeling the dynamics of affective states in a Conversational Embodied Agent. International Journal of Human-Computer Studies, 59:81-118.
21. FIROZABADI, B. S., and A. J. I. JONES. 1998. On the characterisation of a trusting agent; aspects of a formal approach. Workshop on Deception, Fraud and Trust in Agent Societies. Autonomous Agents.
22. FRIEDMAN, N., and J. Y. HALPERN. 1995. Plausibility measures: A User's Guide. Proceedings of the Eleventh Conference on Uncertainty in AI.
23. HORVITZ, E., and T. PAEK. 1999. A Computational Architecture for Conversation. Proceedings of the 7th International Conference on User Modeling. Springer Wien, 201-210.
24. JAMESON, A. 1995. Numerical uncertainty management in user and student modeling: An overview of systems and issues. User Modeling and User-Adapted Interaction. 11:1-2, 129-158.
25. KAPLAN, A. N., and L. K. SCHUBERT. 2000. A computational model of belief. Artificial Intelligence, 120.
26. KASHY, D., and B. DEPAULO. 1996. Who lies? Journal of Personality and Social Psychology 70:5.
27. LEE, M., and Y. WILKS. 1997. Eliminating deception and mistaken belief to infer conversational implicature. IJCAI Workshop on 'Collaboration, Cooperation and Conflict in Dialogue Systems.
28. LELOUCHE, R., and S. DOUBLAIT. 1992. Qualitative reasoning with bluff and beliefs in a multi-actor environment. International Journal of Man-Machine Studies, 36:149-165.
29. NEAPOLITAN, R. E. 1990. Probabilistic Reasoning in Expert Systems: Theory and Algoritms. Wiley-Interscience Publ.
30. PAEK, T., and E. HORVITZ. 2000. Conversation as Action Under Uncertainty. Proceeding of the 16th Conference on Uncertainty in Artificial Intelligence (UAI-2000), Stanford, CA, June, 2000.
31. PEARL, J. 2000, Probabilistic reasoning in intelligent systems: Networks of plausible inference. Morgan Kaufman Publishers.
32. QUARESMA, P., and J. LOPEZ. Modeling credulousness and cooperativeness in a Logic Programming framework. In IJCAI Workshop on "Collaboration, Cooperation, and Conflict in Dialogue Systems."
33. REED, C. A. 1999. The Role of Saliency in Generating Natural Language Arguments. In Proceedings of the 16th International Joint Conference on Artificial Intelligence (IJCAI'99). Morgan Kaufmann, Stockholm, 876-881.
34. REITER, E., and R. DALE. 2000. Building Natural Language Generation Systems. Cambridge University Press.
35. SHAFER, G. 1986. Probability Judgement in Artificial Intelligence. In Uncertainty in Artificial Intelligence. Edited by L. N. Kanal and J. F. Lemmer, Elsevier Science Publishers B. V., North Holland, 4:23-44.
36. SILLINCE, J. A. A., and MINORS, R. H. 1991. What makes a strong argument? Emotions, highly-placed values and role-playing. Communication and Cognition, 24:3-4, 281-298.
37. SPIEGELHALTER, D. J. 1986. Probabilistic Reasoning in Predictive Expert Systems. In Uncertainty in Artificial Intelligence. Edited by L. N. Kanal and J. F. Lemmer. Elsevier Science Publishers B. V., North Holland, Vol. 4:47-68.
38. TURING, A. M. Computing Machinery and Intelligence. Mind, London, N.S., 59, 1950.
39. TVERSKY, A., and D. KAHNEMAN. 1974. Judgement under uncertainty: Heuristics and biases. Science, 185:1124-1131.
40. VINCENT, J., and C. CASTELFRANCHI. 1981. On the art of deception; how to lie while saying the truth. Possibilities and limitations of pragmatics. In Studies in Language Companion Series. 7. Edited by H. Parret, M. Sbisà, and J. Verschueren. John Benjamin's.
41. WALTON, D. N. 1999. Dialectical relevance in persuasion dialogue. Informal Logic, 19:2-3, 119-143.
42. WALTON, D. N. 2000. Argumentation and theory of evidence. In New Trends in Criminal Investigations and Evidence. Vol II. Antwerp, Intersentia, 711-732.
43. WEINSTEIN, M. C., and H. V. FINEBERG. 1980. Clinical Decision Analysis. W. B. Saunders Company Press.
44. WILKS, Y. 1999. Machine Conversations. Kluwer Academic Publishers.
45. ZLOTKIN, G., and J. ROSENSCHEIN. 1991. Incomplete information and deception in multiagent negotiation. XII International Joint Conference on Artificial Intelligence, Sydney.
46. ZUKERMAN, I., N. JINATH, R. McCONACHY, and S. GEORGE. 2000. Recognizing intentions from rejoinders in a Bayesian Interactive Argumentation System. Proceedings of PRICAI.
47. ZUKERMAN, I., and D. LITMAN. 2001. Natural language processing and user modeling: synergies and limitations. User Modeling and User-Adapted Interaction, 11:1-2, 129-158.
48. ZUKERMAN, I., and S. GEORGE. 2002. Towards a noise-tolerant, representation-independent mechanism for argument interpretation. Proceedings of COLING 2002, 1170-1176.