Challenge Protocol

Overview

The tasks which participants will tackle in this challenge are divided into separate phases:

1. A qualification phase in simulation, where the objective is to move a cube to a goal pose. There will be different levels of difficulty, ranging from pushing to picking up and reorienting the object.
2. Participants who passed phase 1 will be granted access to the robots and will be required to solve the same task as in phase 1, but now on the real robots.
3. Building shapes out of small cubes.

Participants will use the robots similarly to a cluster, they can submit jobs, where each job corresponds to executing an episode on a real robot. After termination, participants will have access to the data generated during that episode (all the sensory data and actions taken).

The code will be executed in a Singularity (similar to Docker) image, in which participants can install additional software and test their code in simulation. For this purpose, we provide a simulator with an identical interface as the real robots.

Prizes

In each of the two stages, the following prizes are awarded to the participants with the best scores.

Stage 1
Winner: 3,000 EUR
Runner-up: 1,500 EUR
Third-place: 1,000 EUR
Best Paper: 3,000 EUR
Runner-up best paper: 1,500 EUR

Stage 2
Winner: 3,000 EUR
Runner-up: 1,500 EUR
Third-place: 1,000 EUR
Best Paper: 3,000 EUR
Runner-up best paper: 1,500 EUR

Please note: The prize money is likely to increase and only summarizes the currently available sums. The pre-stage is not awarded any prizes and just serves as a qualification round.

Pre-Stage (Simulation)

Anyone can participate, no registration is required at the beginning of this phase. Participants can simply download a publicly available repository containing the simulator (instructions coming soon).

The goal is to move the cube to a goal pose. There are 4 levels of difficulty:

• Pushing to a goal position on the table.
• Lifting to a certain height.
• Lifting and moving to a goal position.
• Lifting and moving to a goal position and orientation.

Participants’ code will be evaluated on each level, and the level scores will be averaged into an overall score.

At the end of the phase, teams will be required to hand in a 2-page proposal and their code. Teams will be selected based on a combination of their score and the quality of the proposal.

Stage 1

The teams that passed phase 1 will be granted access to the real robots and will be able to submit their code (instructions coming soon). The objective of phase 2 is to solve the same tasks as in phase 1, but now on the real robot.

At the end of phase 2, participants will be required to hand in a 2-page report detailing the approaches used and their code (instructions coming soon). Teams will be ranked based on the score achieved by their code, as long as the report passes an acceptance threshold.

Stage 2

Building shapes out of small cubes, more details coming soon.