Moving Object Detection by 3D Flow Field Analysis | IEEE Journals & Magazine | IEEE Xplore

Moving Object Detection by 3D Flow Field Analysis


Abstract:

Map-based localization and sensing are one of the key components in autonomous driving technologies, where high quality 3D map reconstruction is fundamentally utmost impo...Show More

Abstract:

Map-based localization and sensing are one of the key components in autonomous driving technologies, where high quality 3D map reconstruction is fundamentally utmost important. However, due to the highly dynamic and uncontrollable properties of real world environment, building a high quality 3D map is not straightforward and requires several strong assumptions. To address this challenge, we present a complete framework, which detects and extracts the moving objects from a sequence of unordered and texture-less point clouds, to build high quality static maps. To accurately detect the moving objects from data acquired with a possibly fast moving platform, we propose a novel 3D Flow Field Analysis approach in which we inspect the motion behaviour of the registered point sets. The proposed algorithm elegantly models the temporal and spatial displacement of the moving objects. Thus, both small moving objects (e.g. walking pedestrians) and large moving objects (e.g. moving trucks) can be detected effectively. Further, by incorporating the Sparse Subspace Clustering framework, we propose a Sparse Flow Clustering algorithm to group the 3D motion flows under both the constraints of motion similarity and spatial closeness. To this end, the static scene parts and the moving objects can be independently processed to achieve photo-realistic 3D reconstructions. Finally, we show that the proposed 3D Flow Field Analysis algorithm and the Sparse Flow Clustering approach are highly effective for motion detection and segmentation, as exemplified on the KITTI benchmark, and yield high quality reconstructed static-maps as well as rigidly moving objects.
Published in: IEEE Transactions on Intelligent Transportation Systems ( Volume: 22, Issue: 4, April 2021)
Page(s): 1950 - 1963
Date of Publication: 17 February 2021

ISSN Information:


I. Introduction

Map-based localization and sensing are one of the key components in autonomous driving technologies [40], [46], [48] where high quality 3D map reconstruction is fundamentally utmost important [66]. However, due to the highly dynamic and uncontrollable properties of real world environment, building a high quality 3D map is never easy. In literature, there are significant amount of research on 3D map reconstruction problems, representatively, the traditional image-based Structure-from-Motion [59] technique, the depth-image-based Truncated Signed Distance Function [56] approach, and the lidar-based Localization and Mapping [56], [88] method. Generally, such approaches achieve very nice results for nearly static environments, while the 3D reconstruction quality significantly degrades when facing highly dynamic and crowded environments, see Fig. 1 for example.

3D reconstruction using Lidar Odometery and Mapping (LOAM) [87] technique: top image shows a decent quality 3D map of a static campus environment, while the mapping result (bottom image) of the plaza is quite unsatisfactory due to the “ghost” artefacts (see the zoom-in area of red boxes) caused by moving objects.

References

References is not available for this document.