Cartoon Colorization with Gray Image Generated from Sketch

In this paper, we present a two stages approach to generate the color cartoon image from sketch by generating the grayscale image firstly, then the color cartoon is generated from the grayscale image with colorization methodology. The grayscale cartoon image from sketch is generated with conditional generative adversarial networks (cGAN), the conditions of cGAN will have some effects on the grayscale image such as edge and shade. The final color cartoon image from the grayscale image is generated with Encoder-Decoder UNet, and in this phase, both the prior global and local user hints information will be introduced to control the final color scheme. The benefit of this two phases approach is to generate the high-quality color cartoon image while allowing users to control final effect with more user guide involved. The two phases colorization could be done in almost real-time and user could take tuning for the generated color cartoon image interactively.