Material Location and Stacking Detection Method Based on LIDAR and Camera Fusion

Aiming at the problem of material stacking in outdoor scenes of large warehouses, where accurate detection and localization of materials cannot be achieved with camera-based methods alone, we propose an approach based on LIDAR and camera fusion for material detection and localization. The LIDAR is used to collect 3D point clouds at different locations, and the non-stackable material areas are manually animated by the camera, and the point clouds are mapped with the images through the coordinate system and the pre-calibrated internal and external parameters to accurately obtain the material spatial location information. The results show that material stacking and detection methods based on the fusion of LIDAR and cameras can locate and detect materials in real time, regardless of the problem of indiscriminate stacking.