Loading web-font TeX/Math/Italic
On rival penalization controlled competitive learning for clustering with automatic cluster number selection | IEEE Journals & Magazine | IEEE Xplore

On rival penalization controlled competitive learning for clustering with automatic cluster number selection


Abstract:

The existing rival penalized competitive learning (RPCL) algorithm and its variants have provided an attractive way to perform data clustering without knowing the exact n...Show More

Abstract:

The existing rival penalized competitive learning (RPCL) algorithm and its variants have provided an attractive way to perform data clustering without knowing the exact number of clusters. However, their performance is sensitive to the preselection of the rival delearning rate. In this paper, we further investigate the RPCL and present a mechanism to control the strength of rival penalization dynamically. Consequently, we propose the rival penalization controlled competitive learning (RPCCL) algorithm and its stochastic version. In each of these algorithms, the selection of the delearning rate is circumvented using a novel technique. We compare the performance of RPCCL to RPCL in Gaussian mixture clustering and color image segmentation, respectively. The experiments have produced the promising results.
Published in: IEEE Transactions on Knowledge and Data Engineering ( Volume: 17, Issue: 11, November 2005)
Page(s): 1583 - 1588
Date of Publication: 30 November 2005

ISSN Information:

Citations are not available for this document.

1 Introduction

Competitive learning has been widely applied to a variety of applications such as vector quantization [9], [14], data visualization [8], [13], and particularly to unsupervised clustering [1], [6], [21], [24]. In the literature, k-means [15] is a popular competitive learning algorithm, which trains seed points (also called units hereinafter), denoted as , in a way that they converge to the data cluster centers by minimizing the mean-square-error (MSE) function. In general, k-means algorithm has at least two major drawbacks: 1) It suffers from the dead-unit problem. If the initial positions of some units are far away from the inputs (also called data points interchangeably) in Euclidean space compared to the other units, these distant units will have no opportunity to be trained and, therefore, immediately become dead units. 2) If the number of clusters is misspecified, i.e., is not equal to the true cluster number , the performance of k-means algorithm deteriorates rapidly. Eventually, some of the seed points are not located at the centers of the corresponding clusters. Instead, they are either at some boundary points between different clusters or at points biased from some cluster centers [24].

Cites in Papers - |

Cites in Papers - IEEE (23)

Select All
1.
Wuning Tong, Yuping Wang, Delong Liu, "An Adaptive Clustering Algorithm Based on Local-Density Peaks for Imbalanced Data Without Parameters", IEEE Transactions on Knowledge and Data Engineering, vol.35, no.4, pp.3419-3432, 2023.
2.
Yang Lu, Yiu-Ming Cheung, Yuan Yan Tang, "Self-Adaptive Multiprototype-Based Competitive Learning Approach: A k-Means-Type Algorithm for Imbalanced Data Clustering", IEEE Transactions on Cybernetics, vol.51, no.3, pp.1598-1612, 2021.
3.
Yiu-ming Cheung, Yiqun Zhang, "Fast and Accurate Hierarchical Clustering Based on Growing Multilayer Topology Training", IEEE Transactions on Neural Networks and Learning Systems, vol.30, no.3, pp.876-890, 2019.
4.
Yafang Li, Caiyan Jia, Xiangnan Kong, Liu Yang, Jian Yu, "Locally Weighted Fusion of Structural and Attribute Information in Graph Clustering", IEEE Transactions on Cybernetics, vol.49, no.1, pp.247-260, 2019.
5.
Harikrishna Pillutla, A. Amuthan, "A Extensive Survey of Rival Penalized Techniques", 2018 3rd International Conference on Inventive Computation Technologies (ICICT), pp.185-190, 2018.
6.
Kaixun Hua, Dan A. Simovici, "Dual Criteria Determination of the Number of Clusters in Data", 2018 20th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), pp.201-208, 2018.
7.
Yiqun Zhang, Yiu-ming Cheung, "A fast hierarchical clustering approach based on partition and merging scheme", 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI), pp.846-851, 2018.
8.
Nico Görnitz, Luiz Alberto Lima, Klaus-Robert Müller, Marius Kloft, Shinichi Nakajima, "Support Vector Data Descriptions and k -Means Clustering: One Class?", IEEE Transactions on Neural Networks and Learning Systems, vol.29, no.9, pp.3994-4006, 2018.
9.
Harsh Khatter, Vaishali Aggarwal, Anil K. Ahlawat, "Performance Analysis of the Competitive Learning Algorithms on Gaussian Data in Automatic Cluster Selection", 2016 Second International Conference on Computational Intelligence & Communication Technology (CICT), pp.48-53, 2016.
10.
Yiu-Ming Cheung, Hong Jia, "Unsupervised Feature Selection with Feature Clustering", 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, vol.1, pp.9-15, 2012.
11.
Chang-Dong Wang, Jian-Huang Lai, Dong Huang, "Kernel-Based Clustering with Automatic Cluster Number Selection", 2011 IEEE 11th International Conference on Data Mining Workshops, pp.293-299, 2011.
12.
Yun Yang, Ke Chen, "Time Series Clustering Via RPCL Network Ensemble With Different Representations", IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol.41, no.2, pp.190-199, 2011.
13.
Yao-Jen Chang, Chia-Lu Ho, "SOFNN-based equalization using rival penalized controlled competitive learning for time-varying environments", 2009 International Conference on Wireless Communications & Signal Processing, pp.1-4, 2009.
14.
Tao Li, Wen-jiang Pei, Shao-ping Wang, Yiu-ming Cheung, "Cooperation Controlled Competitive Learning Approach for Data Clustering", 2008 International Conference on Computational Intelligence and Security, vol.1, pp.24-29, 2008.
15.
Davide Bacciu, Antonina Starita, "Competitive Repetition Suppression (CoRe) Clustering: A Biologically Inspired Learning Model With Application to Robust Clustering", IEEE Transactions on Neural Networks, vol.19, no.11, pp.1922-1941, 2008.
16.
Xu Luo, Sulin Pang, Rongqiu Li, "The combination of rival penalized competitive learning and Self-Organizing Map in a class of data clustering", 2008 International Conference on Neural Networks and Signal Processing, pp.320-325, 2008.
17.
Jesmin F. Khan, Reza R. Adhami, Sharif M. A. Bhuiyan, "Color image segmentation utilizing a customized Gabor filter", IEEE SoutheastCon 2008, pp.539-544, 2008.
18.
Shao-ping Wang, Wen-jiang Pei, Yiu-ming Cheung, "An Improved Competitive and Cooperative Learning Approach for Data Clustering", 2007 International Conference on Computational Intelligence and Security (CIS 2007), pp.320-324, 2007.
19.
Sanfeng Chen, Tao Mei, Minzhou Luo, Huawei Liang, "Study on a New RPCCL Clustering Algorithm", 2007 International Conference on Mechatronics and Automation, pp.299-303, 2007.
20.
Xuefeng Liu, Guangrong Ji, Wencang Zhao, Junna Cheng, "Improved Approach of Seed Point Selection in RPCCL Algorithm for Aerial Remote Sensing Hyper-spectral Data Clustering with Data Dimensionality Reduction", Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007), vol.1, pp.860-865, 2007.
21.
Jun Wang, Sun Huixue, "Studies on CAD Systems with Artificial Intelligence", Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007), vol.2, pp.458-463, 2007.
22.
Yiu-ming Cheung, Lap-tak Law, "Rival-Model Penalized Self-Organizing Map", IEEE Transactions on Neural Networks, vol.18, no.1, pp.289-295, 2007.
23.
Yun Yang, Ke Chen, "An Ensemble of Competitive Learning Networks with Different Representations for Temporal Data Clustering", The 2006 IEEE International Joint Conference on Neural Network Proceedings, pp.3120-3127, 2006.

Cites in Papers - Other Publishers (29)

1.
Penghui Li, Qianru Dong, Chao Lu, Guangquan Lu, Xuedong Yan, Chunjiao Dong, , 2024.
2.
Julian Lee, David Perkins, "A simulated annealing algorithm with a dual perturbation method for clustering", Pattern Recognition, vol.112, pp.107713, 2021.
3.
Wuning Tong, Sen Liu, Xiao-Zhi Gao, "A density-peak-based clustering algorithm of automatically determining the number of clusters", Neurocomputing, vol.458, pp.655, 2021.
4.
Donghyeon Lee, HwanHui Jo, Soojung Shim, Jaehyun Kim, Kyungmin Oh, Byeongno Lee, Namho Lee, Seungryong Cho, "Effective noise reduction algorithm for material decomposition in dual-energy X-ray inspection", Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, vol.968, pp.163930, 2020.
5.
Ke-Lin Du, M. N. S. Swamy, Neural Networks and Statistical Learning, pp.275, 2019.
6.
Debaditya Barman, Nirmalya Chowdhury, "A Novel Approach for the Customer Segmentation Using Clustering Through Self-Organizing Map", International Journal of Business Analytics, vol.6, no.2, pp.23, 2019.
7.
Ming Cong, Jianjun Cui, Xiaodong Peng, Weiyong Ji, "Preliminary analytical method for unsupervised remote sensing image classification based on visual perception and a force field", Geocarto International, pp.1, 2017.
8.
Enrique Pelayo, David Buldain, Carlos Orrite, Computational Intelligence, vol.613, pp.419, 2016.
9.
André Eugenio Lazzaretti, Vitor Hugo Ferreira, Hugo Vieira Neto, "New Trends in Power Quality Event Analysis: Novelty Detection and Unsupervised Classification", Journal of Control, Automation and Electrical Systems, 2016.
10.
Huan Xie, Xin Luo, Chao Wang, Shijie Liu, Xiong Xu, Xiaohua Tong, "Multispectral remote sensing image segmentation using rival penalized controlled competitive learning and fuzzy entropy", Soft Computing, 2015.
11.
Vikas Chaudhary, R. S. Bhatia, Anil K. Ahlawat, "Community SOM (CSOM): An Improved Self-Organizing Map Learning Technique", International Journal of Fuzzy Systems, vol.17, no.2, pp.129, 2015.
12.
Ke-Lin Du, M. N. S. Swamy, "Clustering II: Topics in Clustering", Neural Networks and Statistical Learning, pp.259, 2014.
13.
Shaojun Zhu, Jieyu Zhao, Lijun Guo, "Rival Penalized Image Segmentation", Journal of Multimedia, vol.9, no.5, 2014.
14.
Xin Liu, Yiu-ming Cheung, Shu-Juan Peng, Zhen Cui, Bineng Zhong, Ji-Xiang Du, "Automatic motion capture data denoising via filtered subspace clustering and low rank matrix approximation", Signal Processing, vol.105, pp.350, 2014.
15.
Hong Jia, Yiu-ming Cheung, Jiming Liu, "Cooperative and penalized competitive learning with application to kernel-based clustering", Pattern Recognition, vol.47, no.9, pp.3060, 2014.
16.
Vikas Chaudhary, R.S. Bhatia, Anil K. Ahlawat, "An efficient self-organizing map (E-SOM) learning algorithm using group of neurons", International Journal of Computational Intelligence Systems, vol.7, no.5, pp.963, 2014.
17.
Vikas Chaudhary, R.S. Bhatia, Anil K. Ahlawat, "A novel Self-Organizing Map (SOM) learning algorithm with nearest and farthest neurons", Alexandria Engineering Journal, vol.53, no.4, pp.827, 2014.
18.
Hong Jia, Yiu-ming Cheung, Brain and Health Informatics, vol.8211, pp.496, 2013.
19.
Dzung Dinh Nguyen, Long Thanh Ngo, Long The Pham, Context-Aware Systems and Applications, vol.109, pp.239, 2013.
20.
Enrique Pelayo, David Buldain, Carlos Orrite, "Magnitude Sensitive Competitive Learning", Neurocomputing, vol.112, pp.4, 2013.
21.
Chang-Dong Wang, Jian-Huang Lai, Jun-Yong Zhu, "Conscience online learning: an efficient approach for robust kernel-based clustering", Knowledge and Information Systems, vol.31, no.1, pp.79, 2012.
22.
Chang-Dong Wang, Jiang-Huang Lai, "Energy based competitive learning", Neurocomputing, vol.74, no.12-13, pp.2265, 2011.
23.
Yao‐Jen Chang, Sheng‐Sung Yang, Chia‐Lu Ho, "Improving rival penalized competitive learning using density‐evaluated mechanism", Journal of the Chinese Institute of Engineers, vol.33, no.7, pp.1083, 2010.
24.
EZEQUIEL LÓPEZ-RUBIO, JUAN MIGUEL ORTIZ-DE-LAZCANO-LOBATO, "DYNAMIC COMPETITIVE PROBABILISTIC PRINCIPAL COMPONENTS ANALYSIS", International Journal of Neural Systems, vol.19, no.02, pp.91, 2009.
25.
Shanfeng Zhu, Ichigaku Takigawa, Jia Zeng, Hiroshi Mamitsuka, "Field independent probabilistic model for clustering multi-field documents", Information Processing & Management, vol.45, no.5, pp.555, 2009.
26.
Jesmin F. Khan, Reza R. Adhami, Sharif M.A. Bhuiyan, "A customized Gabor filter for unsupervised color image segmentation", Image and Vision Computing, vol.27, no.4, pp.489, 2009.
27.
"Bibliography", Classification Methods for Remotely Sensed Data, Second Edition, pp.317, 2009.
28.
Rui Xu, Don Wunsch, "References" in Clustering, pp.293-330, 2009.
29.
Krista Rizman Žalik, "An efficient k′-means clustering algorithm", Pattern Recognition Letters, vol.29, no.9, pp.1385, 2008.
Contact IEEE to Subscribe

References

References is not available for this document.