Defining and Using Ideal Teammate and Opponent Agent Models

Peter Stone, AT&T Labs -- Research; Patrick Riley and Manuela Veloso, Carnegie Mellon University

A common challenge for agents in multiagent systems is trying to predict what other agents are going to do in the future. Such knowledge can help an agent determine which of its current action options is most likely to achieve its goals. There is a long history in adversarial game playing of using a model of an opponent which assumes that it always acts optimally. Our research extends this strategy to adversarial domains in which the agents have incomplete information, noisy sensors and actuators, and a continuous action space. We introduce "ideal-model-based behavior outcome prediction" (IMBBOP) which models the results of other agents’ future actions in relation to their optimal actions based on an ideal world model. Our technique also includes a method for relaxing this optimality assumption. IMBBOP was a key component of our successful CMUnited-99 simulated robotic soccer application. We define IMBBOP and illustrate its use within the simulated robotic soccer domain. We include empirical results demonstrating the effectiveness of IMBBOP.

This page is copyrighted by AAAI. All rights reserved. Your use of this site constitutes acceptance of all of AAAI's terms and conditions and privacy policy.