Policy gradient approach for learning of soccer player agents: Pass selection of midfielders

Harukazu Igarashi, Hitoshi Fukuoka, Seiji Ishihara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This research develops a learning method for the pass selection problem of midfielders in RoboCup Soccer Simulation games. A policy gradient method is applied as a learning method to solve this problem because it can easily represent the various heuristics of pass selection in a policy function. We implement the learning function in the midfielders' programs of a well-known team, UvA Trilearn Base 2003. Experimental results show that our method effectively achieves clever pass selection by midfielders in full games. Moreover, in this method's framework, dribbling is learned as a pass technique, in essence to and from the passer itself. It is also shown that the improvement in pass selection by our learning helps to make a team much stronger.

Original languageEnglish
Title of host publicationIntelligent Control and Computer Engineering
Pages137-148
Number of pages12
DOIs
Publication statusPublished - 2011 Jan 10
EventInternational Conference on Advances in Intelligent Control and Computer Engineering - Hong Kong, Hong Kong
Duration: 2010 Mar 172010 Mar 19

Publication series

NameLecture Notes in Electrical Engineering
Volume70 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

ConferenceInternational Conference on Advances in Intelligent Control and Computer Engineering
CountryHong Kong
CityHong Kong
Period10/3/1710/3/19

Keywords

  • Multi-agent system
  • Pass selection
  • Policy gradient method
  • Reinforcement learning
  • RoboCup

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Fingerprint Dive into the research topics of 'Policy gradient approach for learning of soccer player agents: Pass selection of midfielders'. Together they form a unique fingerprint.

  • Cite this

    Igarashi, H., Fukuoka, H., & Ishihara, S. (2011). Policy gradient approach for learning of soccer player agents: Pass selection of midfielders. In Intelligent Control and Computer Engineering (pp. 137-148). (Lecture Notes in Electrical Engineering; Vol. 70 LNEE). https://doi.org/10.1007/978-94-007-0286-8_12