Project: Match visualization and analysis

People

  • Ludovic Hofer (Rhoban FC)
  • Maike Paetzel (Bit-Bots)
  • … (other contributors are welcome)

Description
This projects aim at developing three different tools allowing to create large datasets of games usable by the whole league:

  1. A visualizer to display augmented video streams during and after a match
  2. A labeling tool to annotate games either semi-automatically or automatically
    • Humans can provide/confirm position of objects during the game (ball, robots, referees)
    • Using tracking algorithms to reduce the tagging burden
    • Multiple points of view allow to retrieve 3d position for different objects
  3. An analyzer to extract high-level metrics from the labeled data.
    • Based on information from the GameController and the labeling tool
    • Extract high level metrics such as:
      • robot peak speed
      • Localization accuracy
      • Number of pick-ups

Motivations

  • Provide more data based on games played during the tournament
  • Make games more understandable and engaging (display robot intentions)
    • For the public
    • For other teams watching the games
  • Allow measurement of the in-game performance of robots
    • Make tracking of performance along the years easier
    • Ensure the event-triggered roadmap is based on reliable information

Status

A first proof of concept has been created and used based on RoboCup 2019 data:

While it already has functional elements it requires drastical modifications:

  • It does only support a custom protocol from Rhoban yet
  • Performance should strongly be improved to allow
  • Ergonomy is basic
  • Some of the dependencies are outdated
  • Documentation and hands-on tutorial should be made available

Has there been any further work on this? NUbots did begin work on the visualisation portion of this a while back, based on our debugging tool NUsight. We are interested in working on this again, particularly if we are resuming in-person RoboCup competitions, however would like to know if there have been any developments or other teams working on this.

Hi @Ysobel, thanks for your interest. The initiative was “paused” due to COVID not allowing us to work at the lab and develop the setup. Currently we (i.e. Ludovic, Maike, and me) do not have the time to continue on this initiative. We welcome and support any proposals in this direction though and are happy to help.