Online Planning for Ad Hoc Autonomous Agent Teams

Feng Wu, Shlomo Zilberstein, and Xiaoping Chen. Online Planning for Ad Hoc Autonomous Agent Teams. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI), 439-445, Barcelona, Spain, 2011.

Abstract

We propose a novel online planning algorithm for ad hoc team settings -- challenging situations in which an agent must collaborate with unknown teammates without prior coordination. Our approach is based on constructing and solving a series of stage games, and then using biased adaptive play to choose actions. The utility function in each stage game is estimated via Monte-Carlo tree search using the UCT algorithm. We establish analytically the convergence of the algorithm and show that it performs well in a variety of ad hoc team domains.

Bibtex entry:

@inproceedings{WZCijcai11,
  author	= {Feng Wu and Shlomo Zilberstein and Xiaoping Chen},
  title		= {Online Planning for Ad Hoc Autonomous Agent Teams},
  booktitle     = {Proceedings of the Twenty-Second International Joint Conference on
                   Artificial Intelligence},
  year		= {2011},
  pages		= {439-445},
  address       = {Barcelona, Spain},
  url		= {http://rbr.cs.umass.edu/shlomo/papers/WZCijcai11.html}
}

shlomo@cs.umass.edu