Multimodal Physics and Sensor Simulation for Synthesizing Training Data for Robot Manipulation
Bin Picking Track Tasks
The bin picking track is about localizing objects stored chaotically in a bin, computing a grasping pose and executing the pick up. There will be a fully equipped virtual bin picking cell with robot, vacuum and parallel gripper, camera, box and industrial parts to pick. The box is always filled with one type of industrial parts, which are randomly distributed. The simulation will output the following data to the user: system setup, collision models, RGB-D camera data (colored point cloud, depth and color images), states of actuators. The user-contributed controller can control the following items in simulation: robot arm motion commands (TCP poses or trajectories), gripper selection (vacuum/parallel), gripper state (on/off, open/close). Both tasks require the robot controller to clear all parts from the bin, one by one. This includes object localization, grasp planning (incl. gripper selection) and motion planning capabilities in the robot controller. The task is repeated with different industrial parts and environmental boundary conditions at increasing levels of difficulty. The track is split into a Machine Tending and Kitting task.
Machine Tending
The concrete task is that the robot picks a single object out of the box and puts it as precisely at a target location as possible, repeating this until the box is empty. All objects in this setting are known beforehand and CAD models of all relevant objects in this task are provided to the teams during the preparation phase. Hence, this task is attracting model-based bin picking solutions. Scoring will incorporate all 4 KPIs.
Kitting/Warehouse
In this task, the robot picks a single object out of the box and puts or drops it into a target box without placement restrictions. The operation repeats until the box is empty. However, this time objects are not known in advance. The teams will receive CAD models of other, exemplary industrial parts during the preparation phase for validation purposes, but will face different objects in the contest. This task addresses model-free picking solutions. The scoring will neglect the precise placement KPI, which is invalid in this setting.
Participating teams can opt to participate solely in either one or in both of these bin picking tasks.
