User Preference Prediction in Visual Data on Mobile Devices

The article considers the possibility to predict preferences of a user given a set of his or her photos. The novel algorithm is introduced with detection of private photos based on facial clustering. Such photos are analyzed on the mobile device with the lightweight neural networks. The remaining photos may be sent to the remote server to be processed by the state-of-the-art models. In both cases each photo is associated with the outputs of neural networks trained on scene classification and object detection tasks. Qualitative and quantitative results demonstrate the potential of the proposed approach in event recognition and understanding of preferences of celebrities given their real photos from social networks.