Collective intelligence

Computational Intelligence: The Experts Speak

Volumn , Issue , 2003, Pages 245-260

  Wolpert, David H ^a  

^a NASA AMES RESEARCH CENTER   (United States)

Author keywords

Algorithm design and analysis; Games; Heuristic algorithms; Learning; Nash equilibrium; Search problems

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL METHODS;

ALGORITHM DESIGN AND ANALYSIS; GAMES; LEARNING; NASH EQUILIBRIA; SEARCH PROBLEM;

HEURISTIC ALGORITHMS;

EID: 78249270226     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1109/9780470544297.ch17     Document Type: Chapter

References (43)

1. D. H. Wolpert and K. Turner. “Optimal Payoff Functions for Members of Collectives.” Advances Complex Systems, vol. 4, no. 2/3, 265-279, 2001.
2. D. H. Wolpert, K. Turner, and J. Frank. “Using Collective Intelligence to Route Internet Traffic.” In Advances in Neural Information Processing Systems—77, pages 952-958. MIT Press, 1999.
3. D. H. Wolpert, K. Wheeler, and K. Turner. “General Principles of Learning-Based Multi-Agent Systems.” In Proceedings Third International Conference of Autonomous Agents, pages 77-83, 1999.
4. D. H. Wolpert and K. Turner. An Introduction to Collective Intelligence. Technical Report NASA-ARC-IC-99-63, NASA Ames Research Center, 1999. URL:http://ic.arc.nasa.gov/ic/projects/coin_pubs.html. To appear in Handbook of Agent Technology, J. M. Bradshaw, (ed.) AAAI/MIT Press.
5. K. Turner and D. H. Wolpert. “Collective Intelligence and Braess’ Paradox.” In Proceedings of the 17th National Conference on Artificial Intelligence, pages 104-109, Austin, TX, 2000.
6. G. Hardin. “The Tragedy of the Commons.” Science, vol. 162, 1243-1248, 1968.
7. L. P. Kaelbing, M. L. Littman, and A. W. Moore. “Reinforcement Learning: A Survey.” J. Artificial Intelligence Res., vol. 4, 237-285, 1996.
8. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
9. R. S. Sutton. “Learning to Predict by the Methods of Temporal Differences.” Machine Learning, vol. 3, 9-14, 1988.
10. C. Watkins and P. Dayan. “Q-Leaming.” Machine Learning, vol. 8, no. 314, 279-292, 1992.
11. C. Boutilier. “Multiagent Systems: Challenges and Opportunities for Decision Theoretic Planning.” AI Mag., vol. 20, no. 35, 35-13, 1999.
12. C. Claus and C. Boutilier. “The Dynamics of Reinforcement Learning Cooperative Multiagent Systems.” In Proceedings of 15th National Conference on Artificial Intelligence, pages 746-752, Madison, WI, June 1998.
13. J. Hu and M. P. Wellman. “Multiagent Reinforcement Learning: Theoretical Framework and an Algorithm.” In Proceedings Fifteenth International Conference on Machine Learning, pages 242-250, June 1998.
14. M. L. Littman. “Markov Games as a Framework for Multi-Agent Reinforcement Learning.” In Proceedings of the 11th International Conference on Machine Learning, pages 157-163, 1994.
15. T. Sandholm and R. Crites. “Multiagent Reinforcement Learning in the Iterated Prisoner’s Dilemma.” Biosystems, vol. 37 147-166, 1995.
16. D. H. Wolpert and K. Turner. An Introduction to Collective Intelligence. Technical Report NASA-ARC-IC-99-63, NASA Ames Research Center, 1999. URL:http://ic.arc.nasa.gov/ic/projects/coin_pubs.html. To appear in Handbook of Agent Technology, J. M. Bradshaw, (ed.) AAAI/MIT Press.
17. D. Fudenberg and J. Tirole. Game Theory. MIT Press, Cambridge, MA, 1991.
18. D. C. Parkes. Iterative Combinatorial Auctions: Theory and Practice. Ph.D. thesis, University of Pennsylvania, 2001.
19. N. Nisan and A. Ronen. “Algorithmic Mechanism Design.” Games Economic Behavior, vol. 35, 166-196, 2001.
20. R. H. Crites and A. G. Barto. “Improving Elevator Performance Using Reinforcement Learning.” In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo (eds.), Advances in Neural Information Processing Systems—8, pages 1017-1023. MIT Press, 1996.
21. D. H. Wolpert. Theory of design of collectives, pre-print, 2002.
22. D. H. Wolpert. Bounded-rationality game theory, pre-print, 2001.
23. D. H. Wolpert, E. Bandari, and K. Turner. Improving simulated annealing by recasting it as a non-cooperative game. 2001. Submitted.
24. D. Monderer and L. S. Sharpley. “Potential Games.” Games Economic Behavior, vol. 14, 124-143, 1996.
25. D. H. Wolpert, K. Wheeler, and K. Turner. “Collective Intelligence for Control of Distributed Dynamical Systems.” Europhysics Lett., vol. 49, no. 6, March 2000.
26. W. Nicholson. Microeconomic Theory, Seventh Edition, The Dryden Press, 1998.
27. D. H. Wolpert and K. Turner. Collective Intelligence, Data Routing and Braess’ paradox. J. Artificial Intelligence Res. 1995. To appear.
28. D. H. Wolpert, J. Sill, and K. Turner. “Reinforcement Learning in Distributed Domains: Beyond Team Games.” In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, pages 819-824, Seattle, WA, 2001.
29. K. Turner, A. Agogino, and D. Wolpert. “Learning Sequences of Actions in Collectives of Autonomous Agents.” In Proceedings First International Joint Conference on Autonomous Agents Multi-Agent Systems, Bologna, Italy, July 2002.
30. W. B. Arthur. “Complexity in Economic Theory: Inductive Reasoning and Bounded Rationality.” Amer. Econ. Rev., vol. 84, no. 2, 406-411, May 1994.
31. D. Challet and Y. C. Zhang. “On the Minority Game: Analytical and Numerical Studies.” Physica A, vol. 256 514, 1998.
32. C. Boutilier, Y. Shoham, and M. P. Wellman. “Editorial: Economic Principles of Multi-Agent Systems.” Artificial Intelligence J., vol. 94, 1-6, 1997.
33. J. M. Bradshaw, (ed.), Software Agents. MIT Press, 1997.
34. G. Caldarelli, M. Marsili, and Y. C. Zhang. “A Prototype Model of Stock Exchange.” Europhysics Let., vol. 40, 479-484, 1997.
35. B. A. Huberman and T. Hogg. “The Behavior of Computational Ecologies.” In The Ecology of Computation, pages 77-115. North-Holland, 1988.
36. N. R. Jennings, K. Sycara, and M. Wooldridge. A Roadmap of Agent Research and Development. Autonomous Agents Multi-Agent Sys., vol. 1, 7-38, 1998.
37. N. F. Johnson, S. Jarvis, R. Jonson, P. Cheung, Y. R. Kwong, and P. M. Hui. “Volatility and Agent Adaptability in a Self-Organizing Market.” preprint cond-mat/9802177, February 1998.
38. T. Sandholm, K. Larson, M. Anderson, O. Shehory, and F. Tohme. “Anytime Coalition Structure Generation with Worst Case Guarantees.” In Proceedings of the Fifteenth National Conference on Artificial Intelligence, pages 46-53, 1998.
39. S. Sen. Multi-Agent Learning: Papers from the 1997 AAAI Workshop (Technical Report WS-97-03). AAAI Press, Menlo Park, CA, 1997.
40. K. Sycara. “Multiagent Systems.” AI Magazine, vol. 19, no. 2, 79-92, 1998.
41. M. P. Wellman. “A Market-Oriented Programming Environment and Its Application to Distributed Multicommodity Flow Problems.” In J. Art. Intel. Res., 1993.
42. D. Wolpert and J. Lawson. “Designing Agent Collectives for Systems with Markovian Dynamics.” In Proceedings of the First International Joint Conference on Autonomous Agents and Multi-Agent Systems, Bologna, Italy, July 2002.
43. Y. C. Zhang. “Modeling Market Mechanism with Evolutionary Games.” Europhysics Let., March/April 1998.