Multi-Prototypes Convex Merging Based K-Means Clustering Algorithm

Dong LI, Shuisheng ZHOU*, Tieyong ZENG, Raymond H. CHAN

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

K-Means algorithm is a popular clustering method. However, it has two limitations: 1) it gets stuck easily in spurious local minima, and 2) the number of clusters k has to be given a priori. To solve these two issues, a multi-prototypes convex merging based K-Means clustering algorithm (MCKM) is presented. First, based on the structure of the spurious local minima of the K-Means problem, a multi-prototypes sampling (MPS) is designed to select the appropriate number of multi-prototypes for data with arbitrary shapes. Then, a merging technique, called convex merging (CM), merges the multi-prototypes to get a better local minima without k being given a priori. Specifically, CM can obtain the optimal merging and estimate the correct k. By integrating these two techniques with K-Means algorithm, the proposed MCKM is an efficient and explainable clustering algorithm for escaping the undesirable local minima of K-Means problem without given k first. Two theoretical proofs are given to guarantee that the cost of MCKM (MPS+CM) can achieve a constant factor approximation to the optimal cost of the K-Means problem. Experimental results performed on synthetic and real-world data sets have verified the effectiveness of the proposed algorithm.

Original languageEnglish
Pages (from-to)6653-6666
Number of pages14
JournalIEEE Transactions on Knowledge and Data Engineering
Volume36
Issue number11
Early online date13 Dec 2023
DOIs
Publication statusPublished - Nov 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2024 IEEE.

Funding

This work was supported by the National Natural Science Foundation of China under Grants No. 61772020; HKRGC Grants Nos. CUHK14301718, CityU11301120, and C1013-21GF; and CityU Grant 9380101.

Keywords

  • Convex merging
  • K-means
  • multi-prototypes
  • multi-prototypes sampling

Fingerprint

Dive into the research topics of 'Multi-Prototypes Convex Merging Based K-Means Clustering Algorithm'. Together they form a unique fingerprint.

Cite this