Phase 3
- Winner: ardentstork
- Runner-up: sombertortoise
Results of the final evaluation:
| # | Username | Level 1 | Level 2 | Level 3 | Level 4 | Total Weighted Score |
|---|---|---|---|---|---|---|
| 1. | ardentstork | -9239 | -4040 | -6525 | -25625 | -139394 |
| 2. | sombertortoise | -5461 | -8522 | -10323 | -36135 | -198016 |
| 3. | sincerefish | -7428 | -25291 | -26768 | -52311 | -347560 |
| 4. | innocenttortoise | -16872 | -31977 | -33357 | -55611 | -403344 |
| 5. | hushedtomatoe | -18304 | -31917 | -36835 | -60219 | -433521 |
| 6. | troubledhare | -18742 | -42831 | -36272 | -56503 | -439233 |
| 7. | giddyicecream | -33329 | -57372 | -53694 | -59734 | -548090 |
Phase 2
- Winner: ardentstork
- Runner-up: troubledhare
| # | Username | Level 1 | Level 2 | Level 3 | Level 4 | Total Weighted Score |
|---|---|---|---|---|---|---|
| 1. | ardentstork | -5472 | -2898 | -9080 | -21428 | -124221 |
| 2. | troubledhare | -3927 | -4144 | -4226 | -48572 | -219182 |
| 3. | sombertortoise | -8544 | -15199 | -14075 | -44989 | -261123 |
| 4. | sincerefish | -6278 | -13738 | -17927 | -49491 | -285500 |
| 5. | hushedtomatoe | -17976 | -41389 | -41832 | -60815 | -469509 |
| 6. | giddyicecream | -22379 | -46650 | -41655 | -61845 | -488023 |
Reports and Source Code of the Winning Teams
ardentstork
sombertortoise
troubledhare
- Report: OpenReview
- Code:
An aggregated and detailed summary of the results from the challenge is provided in Benchmarking Structured Policies and Policy Optimization for Real-World Dexterous Object Manipulation and the following pre-print on arxiv.
Phase 1
Note: The scores listed here are the ones reported by the users and are based on different, randomly generated goals, so they are not fully comparable. For the decision which teams were allowed to proceed to phase 2, the reports also played an important role.
| Username | Level 1 | Level 2 | Level 3 | Level 4 | Total Weighted Score |
|---|---|---|---|---|---|
| giddyicecream | -32 | -284 | -288 | -501 | -3474 |
| ardentstork | -68 | -188 | -110 | -898 | -4370 |
| hushedtomatoe | -170 | -89 | -109 | -1190 | -5440 |
| sombertortoise | -282 | -126 | -178 | -1403 | -6683 |
| troubledhare | -264 | -479 | -528 | -1495 | -8787 |
| anonymous1 | -247 | -472 | -661 | -1537 | -9327 |
| innocenttortoise | -295 | -763 | -675 | -1519 | -9927 |
| sincerefish | -450 | -560 | -676 | -1785 | -10746 |
| anonymous2 | -367 | -1161 | -897 | -1862 | -12833 |
| anonymous3 | -502 | -1289 | -1134 | -1853 | -13897 |