Real-Time Multi-Camera Video Stitching Algorithm with Adaptive Sensing of Illumination and Dynamic Objects

With the development of digital image processing technology, the demand and application of wide-view video continue to grow. However, the existing stitching algorithms may result in unnatural appearance, misalignment, and ghosting issues when stitching scenes with inconsistent brightness or dynamic objects. To address the above problems, we propose a real-time multi-camera video stitching algorithm with adaptive sensing of illumination and dynamic objects. Within the proposed illumination compensation module, brightness equalization across varying illumination conditions is attained through the application of gain compensation to image blocks. We propose a histogram-based dynamic object detection approach to dynamically detect the presence of moving objects along the stitching seam. This method facilitates the adaptive detection of dynamic entities by analyzing the histogram disparities between the local vicinity of the stitching seam and the broader image context. The experimental results show that it can effectively solve the problem of unnatural stitching results arising from the uneven brightness of the image, and can effectively detect the presence of dynamic objects near the stitching seam so that the effect of the video stitching has been improved.