Policy gradient approach for learning of soccer player agents: Pass selection of midfielders

Harukazu Igarashi, Hitoshi Fukuoka, Seiji Ishihara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This research develops a learning method for the pass selection problem of midfielders in RoboCup Soccer Simulation games. A policy gradient method is applied as a learning method to solve this problem because it can easily represent the various heuristics of pass selection in a policy function. We implement the learning function in the midfielders' programs of a well-known team, UvA Trilearn Base 2003. Experimental results show that our method effectively achieves clever pass selection by midfielders in full games. Moreover, in this method's framework, dribbling is learned as a pass technique, in essence to and from the passer itself. It is also shown that the improvement in pass selection by our learning helps to make a team much stronger.

Original languageEnglish
Title of host publicationLecture Notes in Electrical Engineering
Pages137-148
Number of pages12
Volume70 LNEE
DOIs
Publication statusPublished - 2011
EventInternational Conference on Advances in Intelligent Control and Computer Engineering - Hong Kong
Duration: 2010 Mar 172010 Mar 19

Publication series

NameLecture Notes in Electrical Engineering
Volume70 LNEE
ISSN (Print)18761100
ISSN (Electronic)18761119

Other

OtherInternational Conference on Advances in Intelligent Control and Computer Engineering
CityHong Kong
Period10/3/1710/3/19

    Fingerprint

Keywords

  • Multi-agent system
  • Pass selection
  • Policy gradient method
  • Reinforcement learning
  • RoboCup

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Cite this

Igarashi, H., Fukuoka, H., & Ishihara, S. (2011). Policy gradient approach for learning of soccer player agents: Pass selection of midfielders. In Lecture Notes in Electrical Engineering (Vol. 70 LNEE, pp. 137-148). (Lecture Notes in Electrical Engineering; Vol. 70 LNEE). https://doi.org/10.1007/978-94-007-0286-8_12