vix.ing · top · new · best · stats · spec

RoboCup 2D Soccer Simulation League: Evaluation Challenges

2017/06/14 by Mikhail Prokopenko, Prokopenko, Mikhail, Peter Wang +9
Computer Science · Economics, Econometrics and Finance · Engineering · #Autonomous Vehicle Technology and Safety #FOS: Computer and information sciences #Multiagent Systems (cs.MA) #Software System Performance and Reliability #Sports Analytics and Performance #cs.MA

paper · pdf · doi:10.48550/arxiv.1706.04315

12 pages, RoboCup-2017, Nagoya, Japan, July 2017

arxiv created 2017/06/14 · openalex publication_date 2017/06/14 · arxiv updated 2017/06/15 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We summarise the results of RoboCup 2D Soccer Simulation League in 2016 (Leipzig), including the main competition and the evaluation round. The evaluation round held in Leipzig confirmed the strength of RoboCup-2015 champion (WrightEagle, i.e. WE2015) in the League, with only eventual finalists of 2016 competition capable of defeating WE2015. An extended, post-Leipzig, round-robin tournament which included the top 8 teams of 2016, as well as WE2015, with over 1000 games played for each pair, placed WE2015 third behind the champion team (Gliders2016) and the runner-up (HELIOS2016). This establishes WE2015 as a stable benchmark for the 2D Simulation League. We then contrast two ranking methods and suggest two options for future evaluation challenges. The first one, "The Champions Simulation League", is proposed to include 6 previous champions, directly competing against each other in a round-robin tournament, with the view to systematically trace the advancements in the League. The second proposal, "The Global Challenge", is aimed to increase the realism of the environmental conditions during the simulated games, by simulating specific features of different participating countries.

Citations

Related