Applying the policy gradient method to behavior learning in multiagent systems: The pursuit problem

Seiji Ishihara, Harukazu Igarashi

研究成果: Article査読

6 被引用数 (Scopus)


In the field of multiagent systems, some methods use the policy gradient method for behavior learning. In these methods, the learning problem in the multiagent system is reduced to each agent's independent learning problem by adopting an autonomous distributed behavior determination method. That is, a probabilistic policy that contains parameters is used as the policy of each agent, and the parameters are updated while calculating the maximum gradient so as to maximize the expectation value of the reward. In this paper, first, recognizing the action determination problem at each time step to be a minimization problem for some objective function, the Boltzmann distribution, in which this objective function is the energy function, was adopted as the probabilistic policy. Next, we showed that this objective function can be expressed by such terms as the value of the state, the state action rule, and the potential. Further, as a result of an experiment applying this method to a pursuit problem, good policy was obtained and this method was found to be flexible so that it can be adapted to use of heuristics and to modification of behavioral constraint and objective in the policy.

ジャーナルSystems and Computers in Japan
出版ステータスPublished - 2006 9月 1

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • 情報システム
  • ハードウェアとアーキテクチャ
  • 計算理論と計算数学


「Applying the policy gradient method to behavior learning in multiagent systems: The pursuit problem」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。