Abstract
The incremental extreme learning machine (I-ELM) algorithm provides a low computational complexity training mechanism for single-hidden layer feedforward neworks (SLFNs). However, the original I-ELM algorithm does not consider the node noise situation, and node noise may greatly degrade the performance of a trained SLFN. This paper presents a generalized node noise resistant I-ELM (GNNR-I-ELM) for SLFNs. We first define a noise resistant training objective function for SLFNs. Afterwards, we develop the GNNR-I-ELM algorithm which adds τ nodes into the network at each iteration. The GNNR-I-ELM algorithm estimates the output weights of the newly additive nodes and does not change all the previously trained output weights. Its noise tolerant ability is much better than that of the original I-ELM. Besides, we prove that in terms of the training set mean squared error of noisy networks, the GNNR-I-ELM algorithm converges.
Original language | English |
---|---|
Title of host publication | Neural Information Processing: 24th International Conference, ICONIP 2017, Guangzhou, China, November 14-18, 2017, Proceedings, Part I |
Editors | Derong LIU, Shengli XIE, Yuanqing LI, Dongbin ZHAO, El-Sayed M. EI-ALFY |
Publisher | Springer, Cham |
Pages | 424-433 |
Number of pages | 10 |
ISBN (Electronic) | 9783319700878 |
ISBN (Print) | 9783319700861 |
DOIs | |
Publication status | Published - Nov 2017 |
Externally published | Yes |
Event | 24th International Conference on Neural Information Processing - Guangzhou, China Duration: 14 Nov 2017 → 18 Nov 2017 |
Publication series
Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 10634 |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 24th International Conference on Neural Information Processing |
---|---|
Abbreviated title | ICONIP 2017 |
Country/Territory | China |
City | Guangzhou |
Period | 14/11/17 → 18/11/17 |
Bibliographical note
Publisher Copyright:© Springer International Publishing AG 2017.
Funding
The work was supported by a research grant from the Government of the Hong Kong Special Administrative Region (CityU 11259516).
Keywords
- Additive noise
- Feedforward networks
- Multiplicative noise