Few Shot Contrastive Spectral Clustering with Meta Learning and Neighbor Mining

Spectral clustering is widely used in the field of unsupervised learning and has been successfully applied in various data analysis tasks. However, in practical scenarios, it’s common to get few labeled data at low cost, resulting limited labeled data in few categories, while the rest are completely unlabeled. Relying solely on the unsupervised clustering framework can’t leverage the existing supervised information. Using a supervised meta-learning paradigm alone poses challenges when dealing with the majority categories of completely unlabeled data. Therefore, we propose a few-shot contrastive spectral clustering combined with meta learning and neighbor mining framework (FCSMN). First we leverage few shot labeled information to obtain a meta-learning feature embedding with strong generalization capabilities, and acquire semantic feature spaces using an unsupervised contrastive learning model. Then, we mine neighbors in these two feature spaces separately and align them. Next, we jointly reinforce intra-cluster compactness and inter-cluster separability at both instance and cluster level. To satisfies the conditions of spectral clustering, we impose orthogonality constraints at the last layer. Experiments on three datasets demonstrate the effectiveness our proposed method.