Modeling information exchange opportunities for effective human-computer teamwork

Artificial Intelligence

Volumn 195, Issue , 2013, Pages 528-550

  Kamar, Ece ^a   Gal, Ya'akov ^b,c   Grosz, Barbara J ^c  

^a MICROSOFT RESEARCH   (United States)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^c HARVARD UNIVERSITY   (United States)

Author keywords

Collaborative decision making; Human computer teamwork; Interruption management

Indexed keywords

APPROXIMATION ALGORITHMS; BEHAVIORAL RESEARCH; HUMAN COMPUTER INTERACTION; HUMAN RESOURCE MANAGEMENT; INFORMATION DISSEMINATION; LEARNING SYSTEMS; MICROPHONES; MULTI AGENT SYSTEMS;

COLLABORATIVE DECISION MAKING; COLLABORATIVE GROUPS; COLLABORATIVE PLANNING ALGORITHM; DECISION-MAKING PROBLEM; HUMAN-COMPUTER TEAMWORK; INDIVIDUAL PERFORMANCE; INFORMATION EXCHANGES; INTERRUPTION MANAGEMENT;

DECISION MAKING;

EID: 84884909538     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2012.11.007     Document Type: Article

References (67)

1. C. Amato, A. Carlin, S. Zilberstein, Bounded dynamic programming for decentralized POMDPs, in: AAMAS 2007 Workshop on Multi-agent Sequential Decision Making in Uncertain Domains, 2007.
2. E. Arroyo, T. Selker, Self-adaptive multimodal-interruption interfaces, in: Proceedings International Conference on Intelligent User Interfaces, 2003, pp. 6-11.
3. D. Avrahami, J. Fogarty, S.E. Hudson, Biases in human estimation of interruptibility: Effects and implications for practice, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2007, p. 60.
4. T. Babaian, B.J. Grosz, S.M. Shieber, A writer's collaborative assistant, in: Proceedings of the 7th International Conference on Intelligent User Interfaces, ACM, New York, NY, USA, 2002, pp. 7-14.
5. M. Bazerman, Judgment in Managerial Decision Making, Wiley Publishers, 2001.
6. R. Becker, S. Zilberstein, V. Lesser, C.V. Goldman, Transition- independent decentralized Markov decision processes, in: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, ACM, New York, NY, USA, 2003, pp. 41-48.
7. R. Becker, S. Zilberstein, V. Lesser, Decentralized Markov decision processes with event-driven interactions, in: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 1, 2004, pp. 302-309.
8. R. Becker, V. Lesser, S. Zilberstein, Analyzing myopic approaches for multi-agent communication, in: IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2005, pp. 550-557.
9. D.S. Bernstein, R. Givan, N. Immerman, S. Zilberstein, The complexity of decentralized control of Markov decision processes, Mathematics of Operations Research (2002) 819-840.
10. A. Beynier, A.I. Mouaddib, A polynomial algorithm for decentralized Markov decision processes with temporal constraints, in: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, ACM, New York, NY, USA, 2005, pp. 963-969.
11. C. Boutilier, Sequential optimality and coordination in multiagent systems, in: International Joint Conference on Artificial Intelligence, vol. 16, 1999, pp. 478-485.
12. C. Boutilier, Multiagent systems: Challenges and opportunities for decision-theoretic planning, AI Magazine 20 (4) (1999) 35.
13. M.E. Bratman, Shared cooperative activity, The Philosophical Review 101 (2) (1992) 327-341.
14. C.F. Camerer, Behavioral Game Theory. Experiments in Strategic Interaction, Princeton University Press, 2003 (Chapter 2).
15. W.J. Conover, Practical Nonparametric Statistics, Wiley, New York, 1999.
16. M. Czerwinski, E. Cutrell, E. Horvitz, Instant messaging and interruption: Influence of task type on performance, in: Proceedings of OZCHI, 2000, pp. 356-361.
17. L. Dabbish, R. Kraut, Awareness displays and interruptions in teams, in: Annual Meeting of the Academy of Management, Seattle, 2003.
18. A. Falk, U. Fischbacher, A theory of reciprocity, Games and Economic Behavior 54 (2) (2006) 293-315. (Pubitemid 43180856)
19. J. Fogarty, S.E. Hudson, C.G. Atkeson, D. Avrahami, J. Forlizzi, S. Kiesler, J.C. Lee, J. Yang, Predicting human interruptibility with sensors, ACM Transactions on Computer-Human Interaction (TOCHI) 12 (1) (2005) 119-146. (Pubitemid 40680056)
20. T. Gillie, D. Broadbent, What makes interruptions disruptive? A study of length, similarity, and complexity, Psychological Research 50 (4) (1989) 243-250.
21. C.V. Goldman, S. Zilberstein, Communication-based decomposition mechanisms for decentralized MDPs, Journal of Artificial Intelligence Research 32 (2008) 169-202.
22. B.J. Grosz, S. Kraus, Collaborative plans for complex group action, Artificial Intelligence 86 (2) (1996) 269-357. (Pubitemid 126365534)
23. E.A. Hansen, D.S. Bernstein, S. Zilberstein, Dynamic programming for partially observable stochastic games, in: Proceedings of the National Conference on Artificial Intelligence, AAAI Press/MIT Press, Menlo Park, CA/Cambridge, MA, London, 1999-2004, pp. 709-715.
24. H.M. Hodgetts, D.M. Jones, Interrupting problem solving: Effects of interruption position and complexity, in: Past Reflections, Future Directions: Proceedings of the 40th Australian Psychological Society Annual Conference, Melbourne, Australia, 2005, pp. 128-132.
25. E. Horvitz, J. Apacible, Learning and reasoning about interruption, in: Proceedings of the 5th International Conference on Multimodal Interfaces, ACM, New York, NY, USA, 2003, pp. 20-27.
26. E. Horvitz, A. Jacobs, D. Hovel, Attention-sensitive alerting, in: Proceedings of the Conference on Uncertainty in Artificial Intelligence, vol. 99, 1999, pp. 305-313.
27. E. Horvitz, P. Koch, C.M. Kadie, A. Jacobs, Coordinate: Probabilistic forecasting of presence and availability, in: Proceedings of the Conference on Uncertainty in Artificial Intelligence, 2002.
28. S. Hudson, J. Fogarty, C. Atkeson, D. Avrahami, J. Forlizzi, S. Kiesler, J. Lee, J. Yang, Predicting human interruptibility with sensors: A wizard of Oz feasibility study, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, 2003, pp. 257-264.
29. S.T. Iqbal, B.P. Bailey, Leveraging characteristics of task structure to predict the cost of interruption, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2006, p. 750.
30. D. Kahneman, J.L. Knetsch, R.H. Thaler, Experimental tests of the endowment effect and the Coase theorem, Journal of Political Economy 98 (6) (1990) 1325-1348.
31. E. Kamar, B.J. Grosz, Applying MDP approaches for estimating outcome of interaction in collaborative human-computer settings, in: Multi-Agent Sequential Decision Making in Uncertain Domains, 2007, pp. 25-32.
32. E. Kamar, E. Horvitz, C. Meek, Mobile opportunistic commerce: mechanisms, architecture, and application, in: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, 2008.
33. E. Kamar, Y. Gal, B.J. Grosz, Modeling user perception of interaction opportunities for effective teamwork, in: Proceedings of the 2009 International Conference on Computational Science and Engineering, vol. 4, IEEE Computer Society, 2009, pp. 271-277.
34. R. Khardon, G. Wachman, Noise tolerant variants of the perceptron algorithm, The Journal of Machine Learning Research 8 (2007) 227-248. (Pubitemid 46280179)
35. L. Kocsis, C. Szepesvári, Bandit based Monte-Carlo planning, in: Machine Learning: ECML 2006, 2006, pp. 282-293.
36. R.E. Kraut, P. Attewell, Media use in a global corporation: Electronic mail and organizational knowledge, in: Culture of the Internet, 1997, pp. 323-342.
37. S. LeeTiernan, E. Cutrell, M. Czerwinski, H. Hoffman, Effective notification systems depend on user trust, in: Proceedings of Human-Computer Interaction - INTERACT 2001.
38. D.S. McCrickard, R. Catrambone, C.M. Chewar, J.T. Stasko, Establishing tradeoffs that leverage attention for utility: Empirically evaluating information display in notification systems, International Journal of Human-Computer Studies 58 (5) (2003) 547-582.
39. D. McFarlane, Comparison of four primary methods for coordinating the interruption of people in human-computer interaction, Human-Computer Interaction 17 (1) (2002) 63-139. (Pubitemid 35350569)
40. F.S. Melo, M. Veloso, Decentralized MDPS with sparse interactions, Artificial Intelligence 175 (11) (2011) 1757-1789.
41. F.S. Melo, M.T.J. Spaan, S. Witwicki, Exploiting sparse interactions for optimizing communication in DEC-MDPS, in: Seventh Annual Workshop on Multiagent Sequential Decision Making Under Uncertainty (MSDM-2012), 2012, p. 40.
42. H. Mostafa, V. Lesser, Offline planning for communication by exploiting structured interactions in decentralized MDPS, in: IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technologies, 2009, WI-IAT'09, vol. 2, 2009, pp. 193-200.
43. R. Nair, P. Varakantham, M. Tambe, M. Yokoo, Networked distributed POMDPs: a synthesis of distributed constraint optimization and POMDPs, in: Proceedings of the 20th National Conference on Artificial Intelligence, vol. 1, AAAI Press, 2005, pp. 133-139.
44. B. O'Conaill, D. Frohlich, Timespace in the workplace: Dealing with interruptions, in: Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, 1995, pp. 262-263.
45. F.A. Oliehoek, Decentralized POMDPs, in: Reinforcement Learning: State of the Art, Adaptation, Learning, and Optimization, Springer, Berlin, Heidelberg, 2012.
46. F.A. Oliehoek, M.T.J. Spaan, N. Vlassis, Optimal and approximate q-value functions for decentralized POMDPs, Journal of Artificial Intelligence Research 32 (1) (2008) 289-353.
47. F.A. Oliehoek, M.T.J. Spaan, S. Whiteson, N. Vlassis, Exploiting locality of interaction in factored Dec-POMDPs, in: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 1, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 2008, pp. 517-524.
48. C.H. Papadimitriou, J.N. Tsitsiklis, The complexity of Markov decision processes, Mathematics of Operations Research 12 (3) (1987) 441-450.
49. D.V. Pynadath, M. Tambe, The communicative multiagent team decision problem: Analyzing teamwork theories and models, Journal of Artificial Intelligence Research 16 (2002) 389-423. (Pubitemid 43057178)
50. D.V. Pynadath, M. Tambe, Multiagent teamwork: Analyzing the optimality and complexity of key theories and models, in: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems: Part 2, 2002, pp. 873-880.
51. Z. Rabinovich, C.V. Goldman, J.S. Rosenschein, The complexity of multiagent systems: The price of silence, in: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, ACM, New York, NY, USA, 2003, pp. 1102-1103.
52. K. Renaud, Expediting rapid recovery from interruptions by providing a visualization of application activity, in: Proceedings of OZCHI, 2000, pp. 348-355.
53. J.K. Rilling, A.G. Sanfey, J.A. Aronson, L.E. Nystrom, J.D. Cohen, The neural correlates of theory of mind within interpersonal interactions, Neuroimage 22 (4) (2004) 1694-1703. (Pubitemid 38962657)
54. M. Roth, R. Simmons, M. Veloso, Reasoning about joint beliefs for execution-time communication decisions, in: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, ACM, New York, NY, USA, 2005, pp. 786-793.
55. M. Roth, R. Simmons, M. Veloso, What to communicate? Execution-time decision in multi-agent POMDPs, in: The 8th International Symposium on Distributed Autonomous Robotic Systems, Springer, 2006.
56. M. Roth, R. Simmons, M. Veloso, Exploiting factored representations for decentralized execution in multiagent teams, in: Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, ACM, New York, NY, USA, 2007.
57. P. Rudman, M. Zajicek, Autonomous agent as helper-helpful or annoying?, in: Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IEEE Computer Society, 2006, pp. 170-176.
58. P. Scerri, D. Pynadath, L. Johnson, P. Rosenbloom, M. Si, N. Schurr, M. Tambe, A prototype infrastructure for distributed robot-agent-person teams, in: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, ACM, New York, NY, USA, 2003, pp. 433-440.
59. S. Seuken, S. Zilberstein, Memory-bounded dynamic programming for DEC-POMDPs, in: International Joint Conference on Artificial Intelligence, 2007, pp. 2009-2016.
60. S. Seuken, S. Zilberstein, Formal models and algorithms for decentralized decision making under uncertainty, Autonomous Agents and Multi-Agent Systems 17 (2) (2008) 190-250.
61. H.A. Simon, The architecture of complexity, Proceedings of the American Philosophical Society 106 (6) (1962) 467-482.
62. D. Szer, F. Charpillet, S. Zilberstein, et al., MAA*: A heuristic search algorithm for solving decentralized POMDPs, in: Proceedings of the Twenty-First Conference on Uncertainty in Artificial Intelligence, 2005, pp. 576-583.
63. A. van Wissen, Y. Gal, B.A. Kamphorst, M.V. Dignum, Human-agent teamwork in dynamic environments, Computers in Human Behavior 28 (2012) 23-33.
64. P. Varakantham, J. Kwak, M. Taylor, J. Marecki, P. Scerri, M. Tambe, Exploiting coordination locales in distributed POMDPs via social model shaping, in: Proc. of ICAPS, 2009.
65. S. Voida, E.D. Mynatt, It feels better than filing: Everyday work experiences in an activity-based computing system, in: Proceedings of the 27th International Conference on Human Factors in Computing Systems, ACM, 2009, pp. 259-268.
66. S.J. Witwicki, E.H. Durfee, Influence-based policy abstraction for weakly-coupled DEC-POMDPs, in: Proceedings of the Twentieth International Conference on Automated Planning and Scheduling (ICAPS), 2010.
67. P. Xuan, V. Lesser, S. Zilberstein, Communication decisions in multi-agent cooperation: Model and experiments, in: Proceedings of the Fifth International Conference on Autonomous Agents, ACM, New York, NY, USA, 2001, pp. 616-623.