TY - GEN
T1 - Learning and evolution by minimization of mutual information
AU - LIU, Yong
AU - YAO, Xin
PY - 2002
Y1 - 2002
N2 - Based on negative correlation learning [1] and evolutionary learning, evolutionary ensembles with negative correlation learning (EENCL) was proposed for learning and designing of neural network ensembles [2]. The idea of EENCL is to regard the population of neural networks as an ensemble, and the evolutionary process as the design of neural network ensembles. EENCL used a fitness sharing based on the covering set. Such fitness sharing did not make accurate measurement on the similarity in the population. In this paper, a fitness sharing scheme based on mutual information is introduced in EENCL to evolve a diverse and cooperative population. The effectiveness of such evolutionary learning approach was tested on two real-world problems. This paper has also analyzed negative correlation learning in terms of mutual information on a regression task in the different noise conditions. © Springer-Verlag Berlin Heidelberg 2002.
AB - Based on negative correlation learning [1] and evolutionary learning, evolutionary ensembles with negative correlation learning (EENCL) was proposed for learning and designing of neural network ensembles [2]. The idea of EENCL is to regard the population of neural networks as an ensemble, and the evolutionary process as the design of neural network ensembles. EENCL used a fitness sharing based on the covering set. Such fitness sharing did not make accurate measurement on the similarity in the population. In this paper, a fitness sharing scheme based on mutual information is introduced in EENCL to evolve a diverse and cooperative population. The effectiveness of such evolutionary learning approach was tested on two real-world problems. This paper has also analyzed negative correlation learning in terms of mutual information on a regression task in the different noise conditions. © Springer-Verlag Berlin Heidelberg 2002.
KW - Neural Network
KW - Mutual Information
KW - Hide Node
KW - Individual Network
KW - Evolutionary Learning
UR - http://www.scopus.com/inward/record.url?scp=84944327298&partnerID=8YFLogxK
U2 - 10.1007/3-540-45712-7_48
DO - 10.1007/3-540-45712-7_48
M3 - Conference paper (refereed)
SN - 9783540441397
VL - 2439
T3 - Lecture Notes in Computer Science
SP - 495
EP - 504
BT - Parallel Problem Solving from Nature : PPSN VII 7th International Conference, Granada, Spain, September 7-11, 2002, Proceedings
A2 - MERELO GUERVÓS, Juan Julián
A2 - ADAMIDIS, Panagiotis
A2 - BEYER, Hans-Georg
A2 - SCHWEFEL, Hans-Paul
A2 - FERNÁNDEZ-VILLACAÑAS, José-Luis
PB - Springer Berlin Heidelberg
T2 - PPSN 2002: International Conference on Parallel Problem Solving from Nature
Y2 - 7 September 2002 through 11 September 2002
ER -