Abstract
The imbalanced Extreme Learning Machine based on kernel density estimation (imELM-kde) is a latest classification algorithm for handling the imbalanced binary-class classification. By adjusting the real outputs of training data with intersection point of two probability density f unctions (p.d.f.s) corresponding to the predictive outputs of majority and minority classes, imELM-kde updates ELM which is trained based on the original training data and thus improves the performance of ELM-based imbalanced classifier. In this paper, we analyze the shortcomings of imELM-kde and then propose an improved version of imELM-kde. The Parzen window method used in imELMkde leads to multiple intersection points between p.d.f.s of majority and minority classes. In addition, it is unreasonable to update the real outputs with intersection point, because the p.d.f.s are estimated based on the predictive outputs. Thus, in order to improve the shortcomings of imELM-kde, an imbalanced ELM based on normal density estimation (imELM-nde) is proposed in this paper. In imELM-nde, the p.d.f.s of predictive outputs corresponding to majority and minority classes are computed with normal density estimation and the intersection point is used to update the predictive outputs instead of real outputs. This makes the training of probability density estimation-based imbalanced ELM simpler and more feasible. The comparative results show that our proposed imELM-nde performs better than unweighted ELM and imELM-kde for imbalanced binary-class classification problem.
Original language | English |
---|---|
Title of host publication | Trends and Applications in Knowledge Discovery and Data Mining: PAKDD 2016 Workshops, BDM, MLSDA, PACC, WDMBF, Auckland, New Zealand, April 19, 2016, Revised Selected Papers |
Editors | Huiping CAO, Ruili WANG, Jinyan LI |
Publisher | Springer, Cham |
Pages | 48-60 |
Number of pages | 13 |
ISBN (Print) | 9783319429953 |
DOIs | |
Publication status | Published - 2016 |
Externally published | Yes |
Publication series
Name | Lecture Notes in Computer Science |
---|---|
Volume | 9794 |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Funding
This work is supported by China Postdoctoral Science Foundations (2015M572361 and 2016T90799), Basic Research Project of Knowledge Innovation Program in Shenzhen (JCYJ201503241400368 25), and National Natural Science Foundations of China (61503252, 61473194, 71371063, and 61473111).
Keywords
- Extreme learning machine
- Imbalanced classification
- Kernel density estimation
- Normal density estimation
- Probability density function