Automatic modularization with speciated neural network ensemble

Vineet R. KHARE, Xin YAO

Research output: Book Chapters | Papers in Conference ProceedingsBook ChapterResearchpeer-review


Decomposing a complex computational problem into sub-problems, which are computationally simpler to solve individually and which can be combined to produce a complete solution, can efficiently lead to compact and general solutions. Neural network ensemble is one such modular system that uses this divide-and-conquer strategy. Diverse set of networks improves ensemble's performance over its constituent networks. Artificial speciation is used here to produce this diverse set of networks that solve different parts of a data classification task and complement each other in solving the complete problem. Fitness sharing is used in evolving the group of neural networks to achieve the required speciation. Sharing is performed at phenotypic level using modified Kullback-Leibler entropy as the distance measure. The group as a unit solves the classification problem and outputs of all the networks are used in finding the final output. For the combination of neural network outputs 3 different methods - Voting, averaging and recursive least square are used. The evolved system is tested on two data classification problems (Heart Disease Dataset and Breast Cancer Dataset) taken from UCI machine learning benchmark repository.
Original languageEnglish
Title of host publicationRecent Advances in Simulated Evolution and Learning
EditorsKay Chen TAN, Meng Hiot LIM, Xin YAO, Lipo WANG
PublisherWorld Scientific
Number of pages16
ISBN (Print)9789812389527
Publication statusPublished - 2004
Externally publishedYes

Publication series

NameAdvances in Natural Computation
PublisherWorld Scientific
ISSN (Print)2010-295X


Dive into the research topics of 'Automatic modularization with speciated neural network ensemble'. Together they form a unique fingerprint.

Cite this