3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media | IEEE Journals & Magazine | IEEE Xplore

3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media


Abstract:

Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the...Show More

Abstract:

Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the object motion limit, the prior of the object information, or the complex optical setup. Here, we focus on reconstructing the 3D location and trajectory of an object in motion behind scattering media by explicitly modeling and inverting the time-varying light transportation. A time-varying scattering imaging model is derived to encode the positions of the moving object in the intensity videos captured by a conventional RGB camera. Based on the model, we find that the object lies on 3D surfaces determined by point pairs on the scattering media. We then develop a back-projection method to build a 3D confidence map for the voxelized object space to find the voxel with the maximum confidence as the object position in the reconstructed trajectory at the corresponding video time. The effectiveness of the proposed method to locate moving self-illuminated and light-reflective objects in different shapes behind scattering media with different thicknesses using 2D intensity images is verified by simulated experiments and real scattering imaging systems. The reconstructions of multiple objects and different lighting conditions are discussed.
Published in: IEEE Transactions on Computational Imaging ( Volume: 8)
Page(s): 371 - 384
Date of Publication: 27 April 2022

ISSN Information:

Funding Agency:


I. Introduction

The ability to locate an object in motion behind scattering media shows great significance in a wide range of applications such as bioscience, autonomous navigation, military actions, and rescue operations. However, the location information especially the depth is lost by capturing the reflected or self-illuminated light from the moving object using the conventional RGB cameras. Even using the camera with depth detection capability, because of the existence of scattering media, the object location information is submerged in the scattered light, which makes reconstructing the 3D location and trajectory of a moving object behind scattering media using ray tracing [1]–[3] or phase shift decoding [4], [5] become ineffective.

References

References is not available for this document.