CloudU-Net: A Deep Convolutional Neural Network Architecture for Daytime and Nighttime Cloud Images’ Segmentation

Cloud segmentation is one of the hot tasks in the field of weather forecast, environmental monitoring, site selection for observatory, and other areas. In this letter, we proposed a new deep convolutional neural network architecture called CloudU-Net for daytime and nighttime cloud images’ segmentation. The net consists of dilated convolution, activation, batch normalization (BN), max pooling, upsampling, skip connection, and fully connected conditional random field (CRF) layers. The benefits of the net architecture are four aspects: First, the dilated convolution increases the receptive field of the filters to obtain more information of the context without increasing the extra amount of computation and the extra number of parameters. Second, the BN layer increases the speed of network training and prevents over-fitting. Third, the fully connected CRF optimizes the output of the front end of the architecture, and finally gets better segmentation results. Finally, the enhanced optimizer Lookahead improves the learning stability and speeds up model convergence. Compared with the current deep-learning-based state-of-the-art cloud images’ segmentation algorithms, the CloudU-Net demonstrates better segmentation performance for daytime and nighttime cloud images.