Designing Neural Network Ensembles by Minimizing Mutual Information

Yong LIU, Xin YAO, Tetsuya HIGUCHI

Research output: Book Chapters | Papers in Conference ProceedingsBook ChapterResearchpeer-review


This chapter describes negative correlation learning for designing neural network ensembles. Negative correlation learning has been firstly analysed in terms of minimising mutual information on a regression task. By minimising the mutual information between variables extracted by two neural networks, they are forced to convey different information about some features of their input. Based on the decision boundaries and correct response sets, negative correlation learning has been further studied on two pattern classification problems. The purpose of examining the decision boundaries and the correct response sets is not only to illustrate the learning behavior of negative correlation learning, but also to cast light on how to design more effective neural network ensembles. The experimental results showed the decision boundary of the trained neural network ensemble by negative correlation learning is almost as good as the optimum decision boundary.
Original languageEnglish
Title of host publicationComputational Intelligence in Control
EditorsMasoud MOHAMMADIAN, Rahul A. SARKER, Xin YAO
PublisherIdea Group Publishing
Number of pages21
ISBN (Electronic)9781591400790
ISBN (Print)9781591400370
Publication statusPublished - 2003
Externally publishedYes


Dive into the research topics of 'Designing Neural Network Ensembles by Minimizing Mutual Information'. Together they form a unique fingerprint.

Cite this