Multimodal Sensor Fusion for Robust Obstacle Detection and Classification in the Maritime RobotX Challenge

This paper describes a novel probabilistic sensor fusion framework aimed at improving obstacle detection accuracy and classification of various targets experienced in the Maritime RobotX Challenge. In both the 2014 and 2016 Maritime RobotX Challenges, it was found that detecting obstacles using LIDAR only and classifying obstacles using vision only can be challenged by environmental conditions, such as glare from the sun or by objects such as the spherical black buoys from the obstacle field that disperses LIDAR rays. In this paper, a new multimodal sensor fusion approach is proposed that combines data streams from perception sensors, such as LIDAR, RADAR, and cameras, to improve the robustness of detection and classification performance over a single sensor method. Using data collected from both the 2014 and 2016 Maritime RobotX Challenges, an evaluation of the perception framework is provided. The proposed detection and classification framework is now being transferred to the Queensland University of Technology (QUT) autonomous surface vehicle to improve overall mapping accuracy and task execution.