Introducing decision entrustment mechanism into repeated bilateral agent interactions to achieve social optimality
Author(s)
Hao, Jianye; Leung, Ho-fung
Download10458_2014_9265_ReferencePDF.pdf (1.133Mb)
PUBLISHER_POLICY
Publisher Policy
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Terms of use
Metadata
Show full item recordAbstract
During multiagent interactions, robust strategies are needed to help the agents to coordinate their actions on efficient outcomes. A large body of previous work focuses on designing strategies towards the goal of Nash equilibrium under self-play, which can be extremely inefficient in many situations such as prisoner’s dilemma game. To this end, we propose an alternative solution concept, socially optimal outcome sustained by Nash equilibrium (SOSNE), which refers to those outcomes that maximize the sum of all agents’ payoffs among all the possible outcomes that can correspond to a Nash equilibrium payoff profile in the infinitely repeated games. Adopting the solution concept of SOSNE guarantees that the system-level performance can be maximized provided that no agent will sacrifice its individual profits. On the other hand, apart from performing well under self-play, a good strategy should also be able to well respond against those opponents adopting different strategies as much as possible. To this end, we consider a particular class of rational opponents and we target at influencing those opponents to coordinate on SOSNE outcomes. We propose a novel learning strategy TaFSO which combines the characteristics of both teacher and follower strategies to effectively influence the opponent’s behavior towards SOSNE outcomes by exploiting their limitations. Extensive simulations show that our strategy TaFSO achieves better performance in terms of average payoffs obtained than previous work under both self-play and against the same class of rational opponents.
Date issued
2014-05Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence LaboratoryJournal
Autonomous Agents and Multi-Agent Systems
Publisher
Springer US
Citation
Hao, Jianye, and Ho-fung Leung. “Introducing Decision Entrustment Mechanism into Repeated Bilateral Agent Interactions to Achieve Social Optimality.” Autonomous Agents and Multi-Agent Systems 29, no. 4 (May 17, 2014): 658–682.
Version: Author's final manuscript
ISSN
1387-2532
1573-7454