Leaderboards

Want to submit a benchmarking asset to be listed? Use this Google form: https://forms.gle/LHrtmDpm82X4qrDk6 

We are building repositories of benchmarking assets for robot manipulation. Help us build it! Use the Google form linked above to submit an open-source product or give us feedback on how it's organized by joining the COMPARE Slack workspace linked at the bottom of the page!

Relevant COMPARE Slack Channel: #benchmarking

Leaderboards are either hosted by COMPARE or linked to each effort's respective website. 

Each of the COMPARE leaderboards are comprised of performance metrics derived from experiments using a benchmarking protocol along with other benchmarking assets like standard objects, tools, and datasets, many of which are included in the benchmarking repositories. When available, open-source products from the software components or hardware designs repositories used in the score are also cataloged on the leaderboard.

RGMC = Robotic Grasping and Manipulation Competitions