Human Short Long-Term Cognitive Memory Mechanism for Visual Monitoring in IoT-Assisted Smart Cities

In the industry 4.0 era, the visualization and real-time automatic monitoring of smart cities supported by the Internet of Things is becoming increasingly important. The use of filtering algorithms in smart city monitoring is a feasible method for this purpose. However, maintaining fast and accurate monitoring in complex surveillance environments with restricted resources remains a major challenge. Since the cognitive theory in visual monitoring is difficult to realize in practice, efficient monitoring of complex environments is accordingly hard to be achieved. Moreover, current monitoring methods do not consider the particularities of the human cognitive system, so the remonitoring ability of the process/target is weak in case of monitoring failure by the monitoring system. To overcome these issues, this article proposes a novel human short-long cognitive memory mechanism for video surveillance in smart cities. In this mechanism, a memory with a high reliability target is used as a “long-term memory,” whereas a memory with a low reliability target is used as a “short-term memory.” During the monitoring process, the “short-term memory” and “long-term memory” alternation strategy is combined with the stored target appearance characteristics, ensuring that the original model in the memory will not be contaminated or mislaid by changes in the external environment (occlusion, fast motion, motion blur, and background clutter). Extensive simulations showcase that the algorithm proposed in this article not only improves the monitoring speed without hindering its real-time operation but also monitors and traces the monitored target accurately, ultimately improving the robustness of the detection in complex scenery, and enabling its application to IoT-assisted smart cities.

I. Introduction

In the new wave of artificial intelligence [1]–[3], machine intelligence has become a hotspot for many scholars. Studies have shown that more than 70% of human perception of the external environment comes from the machine vision system [4], [5]. Therefore, the intelligent development of machines cannot be decoupled from the advancement in computer vision technology. As an essential part of computer vision, visual monitoring has been playing a signification role in the fields of unmanned driving and industrial monitoring [6]–[9]. However, the problems of illumination variation, scale variation, occlusion, deformation, and motion blur stemming from the monitoring process need to be further addressed.