Abstract
K-Means algorithm is a popular clustering method. However, it has two limitations: 1) it gets stuck easily in spurious local minima, and 2) the number of clusters k has to be given a priori. To solve these two issues, a multi-prototypes convex merging based K-Means clustering algorithm (MCKM) is presented. First, based on the structure of the spurious local minima of the K-Means problem, a multi-prototypes sampling (MPS) is designed to select the appropriate number of multi-prototypes for data with arbitrary shapes. Then, a merging technique, called convex merging (CM), merges the multi-prototypes to get a better local minima without k being given a priori. Specifically, CM can obtain the optimal merging and estimate the correct k. By integrating these two techniques with K-Means algorithm, the proposed MCKM is an efficient and explainable clustering algorithm for escaping the undesirable local minima of K-Means problem without given k first. Two theoretical proofs are given to guarantee that the cost of MCKM (MPS+CM) can achieve a constant factor approximation to the optimal cost of the K-Means problem. Experimental results performed on synthetic and real-world data sets have verified the effectiveness of the proposed algorithm.
Original language | English |
---|---|
Number of pages | 16 |
Journal | IEEE Transactions on Knowledge and Data Engineering |
DOIs | |
Publication status | E-pub ahead of print - 13 Dec 2023 |
Externally published | Yes |
Bibliographical note
Publisher Copyright: IEEEThis work was supported by the National Natural Science Foundation of China under Grants No. 61772020; HKRGC Grants Nos. CUHK14301718, CityU11301120, and C1013-21GF; and CityU Grant 9380101.
Keywords
- K-Means
- multi-prototypes
- multi-prototypes sampling
- convex merging