Field Programmable Gate Arrays Based Multi Camera Thermal and Day Vision Video Processing and Distribution System

In this paper, a real-time video management system for automotive that can capture and process video streams from up to 24 cameras is proposed. The system is composed of two different type of modules one capture module and the other is management module. System can be scaled up to 4 capture modules that a number of 12 day vision and 12 thermal cameras can be integrated in total. Both capture module and video management module have their own image processing capabilities. The video management module can stream out raw video via HD-SDI or Ethernet interfaces. The video is transferred in RFC4175 form via Gigabit ethernet interface which is also novel to this work. The total glass-to-glass delay of the implemented system is achieved under 150 ms. The system contains 5 FPGA chips fabricated at 16nm process technology for the highest configuration. Each module in the system contains one FPGA chip. A GPU based module may also be installed into the video management system thanks to its scalable architecture. The total video throughput of the highest configuration of the system is 12×1080p×30 fps + 12×640×512×25 fps.