Sequential Decision Making with Untrustworthy Service Providers

Teacy, W. T. L., Chalkiadakis, G., Rogers, A. and Jennings, N. R. (2008) Sequential Decision Making with Untrustworthy Service Providers. In: Proceedings of the 7th International Conference on Autonomous Agents and Multiagent Systems, 12th-16th May, 2008, Estoril, Portugal. pp. 755-762.

Download

Preview

PDF 265Kb

Abstract

In this paper, we deal with the sequential decision making problem of agents operating in computational economies, where there is uncertainty regarding the trustworthiness of service providers populating the environment. Specifically, we propose a generic Bayesian trust model, and formulate the optimal Bayesian solution to the exploration-exploitation problem facing the agents when repeatedly interacting with others in such environments. We then present a computationally tractable Bayesian reinforcement learning algorithm to approximate that solution by taking into account the expected value of perfect information of an agent's actions. Our algorithm is shown to dramatically outperform all previous finalists of the international Agent Reputation and Trust (ART) competition, including the winner from both years the competition has been run.

Item Type:	Conference or Workshop Item
Creator/Authors:	W. T. L. Teacy G. Chalkiadakis A. Rogers N. R. Jennings
Keywords:	Trust, Reputation, Multiagent Systems, Uncertainty, Reinforcement Learning
Research Group:	Old ECS Groups > Intelligence, Agents, Multimedia Current ECS Groups > Agents, Interaction and Complexity
Date:	May 2008
Information about this record:
Performance Indicator:	EZ~04~04~04
Citations:	Google Scholar: 20
Downloads (2010):	52
ID Code:	15168
Last Modified:	23 Sep 2011 10:36
Deposited On:	08 Feb 2008 10:06 by Teacy, Luke

Tools & Metadata

Download Statistics

Members of ECS may view the download statistics dashboard for this record.

Corrections

ECS staff and postgraduates may modify this record