Abstract
This paper presents a new cooperative ensemble learning system (CELS) for designing neural network ensembles. The idea behind CELS is to encourage different individual networks in an ensemble to learn different parts or aspects of the training data so that the ensemble can learn the whole training data better. Rather than producing unbiased individual networks whose errors are uncorrelated, CELS tends to create negatively correlated networks with a novel correlation penalty term in the error function to encourage such specialization. In CELS, individual networks are trained simultaneously rather than sequentially. This provides an opportunity for different networks to cooperate with each other and to specialize. This paper analyzes CELS in terms of bias-variance-covariance trade-off. Experiments on a real-world problem demonstrate that CELS can produce neural network ensembles with good generalization ability.
Original language | English |
---|---|
Title of host publication | The 1998 IEEE International Joint Conference on Neural Networks Proceedings |
Publisher | IEEE |
Pages | 2202-2207 |
Number of pages | 6 |
Volume | 3 |
DOIs | |
Publication status | Published - 1998 |
Externally published | Yes |
Event | 1998 IEEE World Congress on Computational Intelligence - Anchorage, United States Duration: 4 May 1998 → 9 May 1998 |
Congress
Congress | 1998 IEEE World Congress on Computational Intelligence |
---|---|
Country/Territory | United States |
City | Anchorage |
Period | 4/05/98 → 9/05/98 |