Persistent Link:
http://hdl.handle.net/10150/194382
Title:
Multiagent Learning with Bargaining - A Game Theoretic Approach
Author:
Qiao, Haiyan
Issue Date:
2007
Publisher:
The University of Arizona.
Rights:
Copyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author.
Abstract:
Learning in the real world occurs when an agent, which perceives its current state and takes actions, interacts with the environment, which in return provides a positive or negative feedback. The field of reinforcement learning studies such processes and attempts to find policies that map states of the world to the actions of agents in order to maximize cumulative reward over the long run. In multi-agent systems, agent learning becomes more challenging, since the optimal action of each agent generally depends on the actions of other agents. Most studies in multiagent learning research employ non-cooperative equilibrium as a learning objective. However, in many situations, the equilibrium gives worse payoffs to both players than their payoffs would be in the case of cooperation. Therefore the agents have strong desire to choose a cooperative solution instead of the non-cooperative equilibrium. In this work, we apply the Nash Bargaining Solution (NBS) to multi-agent systems with unknown parameters and design a multiagent learning algorithm based on bargaining, in which the agents can reach the NBS by learning through experience. We show that the solution is unique and is Pareto-optimal. We also prove theoretically that the algorithm converges. In addition, we extend the work to multi-agent systems with asymmetric agents having different powers in decision making and design a multiagent learning algorithm with asymmetric bargaining. To evaluate these learning algorithms and compare with the existing learning algorithms, the benchmark, grid world games, are adopted as the simulation test-bed. The simulation results demonstrate that our learning algorithms converge to the unique Pareto-optimal solution and the convergence is faster in comparison to the existing multiagent learning algorithms. Finally, we discuss an application of multiagent learning algorithms to a classic economic model, which is known as oligopoly.
Type:
text; Electronic Dissertation
Degree Name:
PhD
Degree Level:
doctoral
Degree Program:
Electrical & Computer Engineering; Graduate College
Degree Grantor:
University of Arizona
Advisor:
Rozenblit, Jerzy; Szidarovszky, Ferenc
Committee Chair:
Rozenblit, Jerzy; Szidarovszky, Ferenc

Full metadata record

DC FieldValue Language
dc.language.isoENen_US
dc.titleMultiagent Learning with Bargaining - A Game Theoretic Approachen_US
dc.creatorQiao, Haiyanen_US
dc.contributor.authorQiao, Haiyanen_US
dc.date.issued2007en_US
dc.publisherThe University of Arizona.en_US
dc.rightsCopyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author.en_US
dc.description.abstractLearning in the real world occurs when an agent, which perceives its current state and takes actions, interacts with the environment, which in return provides a positive or negative feedback. The field of reinforcement learning studies such processes and attempts to find policies that map states of the world to the actions of agents in order to maximize cumulative reward over the long run. In multi-agent systems, agent learning becomes more challenging, since the optimal action of each agent generally depends on the actions of other agents. Most studies in multiagent learning research employ non-cooperative equilibrium as a learning objective. However, in many situations, the equilibrium gives worse payoffs to both players than their payoffs would be in the case of cooperation. Therefore the agents have strong desire to choose a cooperative solution instead of the non-cooperative equilibrium. In this work, we apply the Nash Bargaining Solution (NBS) to multi-agent systems with unknown parameters and design a multiagent learning algorithm based on bargaining, in which the agents can reach the NBS by learning through experience. We show that the solution is unique and is Pareto-optimal. We also prove theoretically that the algorithm converges. In addition, we extend the work to multi-agent systems with asymmetric agents having different powers in decision making and design a multiagent learning algorithm with asymmetric bargaining. To evaluate these learning algorithms and compare with the existing learning algorithms, the benchmark, grid world games, are adopted as the simulation test-bed. The simulation results demonstrate that our learning algorithms converge to the unique Pareto-optimal solution and the convergence is faster in comparison to the existing multiagent learning algorithms. Finally, we discuss an application of multiagent learning algorithms to a classic economic model, which is known as oligopoly.en_US
dc.typetexten_US
dc.typeElectronic Dissertationen_US
thesis.degree.namePhDen_US
thesis.degree.leveldoctoralen_US
thesis.degree.disciplineElectrical & Computer Engineeringen_US
thesis.degree.disciplineGraduate Collegeen_US
thesis.degree.grantorUniversity of Arizonaen_US
dc.contributor.advisorRozenblit, Jerzyen_US
dc.contributor.advisorSzidarovszky, Ferencen_US
dc.contributor.chairRozenblit, Jerzyen_US
dc.contributor.chairSzidarovszky, Ferencen_US
dc.contributor.committeememberHariri, Salimen_US
dc.contributor.committeememberBarnard, Kobusen_US
dc.identifier.proquest2259en_US
dc.identifier.oclc659748098en_US
All Items in UA Campus Repository are protected by copyright, with all rights reserved, unless otherwise indicated.