Sim-Grasp: Learning 6-DOF Grasp Policies for Cluttered Environments Using a Synthetic Benchmark

In this letter, we present
Sim-Grasp
, a robust 6-DOF two-finger grasping system that integrates advanced language models for enhanced object manipulation in cluttered environments. We introduce the Sim-Grasp-Dataset, which includes 1,550 objects across 500 scenarios with 7.9 million annotated labels, and develop
Sim-GraspNet
to generate grasp poses from point clouds. The
Sim-Grasp-Polices
achieve grasping success rates of 97.14% for single objects and 87.43% and 83.33% for mixed clutter scenarios of Levels 1–2 and Levels 3–4 objects, respectively. By incorporating language models for target identification through text and box prompts,
Sim-Grasp
enables both object-agnostic and target picking, pushing the boundaries of intelligent robotic systems.