Semisupervised Negative Correlation Learning

Huanhuan CHEN, Bingbing JIANG, Xin YAO

Research output: Journal PublicationsJournal Article (refereed)peer-review

16 Citations (Scopus)

Abstract

Negative correlation learning (NCL) is an ensemble learning algorithm that introduces a correlation penalty term to the cost function of each individual ensemble member. Each ensemble member minimizes its mean square error and its error correlation with the rest of the ensemble. This paper analyzes NCL and reveals that adopting a negative correlation term for unlabeled data is beneficial to improving the model performance in the semisupervised learning (SSL) setting. We then propose a novel SSL algorithm, Semisupervised NCL (SemiNCL) algorithm. The algorithm considers the negative correlation terms for both labeled and unlabeled data for the semisupervised problems. In order to reduce the computational and memory complexity, an accelerated SemiNCL is derived from the distributed least square algorithm. In addition, we have derived a bound for two parameters in SemiNCL based on an analysis of the Hessian matrix of the error function. The new algorithm is evaluated by extensive experiments with various ratios of labeled and unlabeled training data. Comparisons with other state-of-the-art supervised and semisupervised algorithms confirm that SemiNCL achieves the best overall performance. © 2012 IEEE.
Original languageEnglish
Article number8305639
Pages (from-to)5366-5379
Number of pages14
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume29
Issue number11
Early online date1 Mar 2018
DOIs
Publication statusPublished - Nov 2018
Externally publishedYes

Bibliographical note

This work was supported in part by the National Key Research and Development Program of China under Grant 2016YFB1000905, in part by the National Natural Science Foundation of China under Grant 91546116, Grant 91746209, and Grant 61673363, and in part by the Science and Technology Innovation Committee Foundation of Shenzhen under Grant ZDSYS201703031748284.

Keywords

  • Committee machines
  • ensemble learning
  • multiple classifiers
  • negative correlation learning
  • semi-supervised learning

Fingerprint

Dive into the research topics of 'Semisupervised Negative Correlation Learning'. Together they form a unique fingerprint.

Cite this