Unified eigen analysis on multivariate Gaussian based estimation of distribution algorithms

Weishan DONG, Xin YAO

Research output: Journal PublicationsJournal Article (refereed)peer-review

57 Citations (Scopus)


Multivariate Gaussian models are widely adopted in continuous estimation of distribution algorithms (EDAs), and covariance matrix plays the essential role in guiding the evolution. In this paper, we propose a new framework for multivariate Gaussian based EDAs (MGEDAs), named eigen decomposition EDA (ED-EDA). Unlike classical EDAs, ED-EDA focuses on eigen analysis of the covariance matrix, and it explicitly tunes the eigenvalues. All existing MGEDAs can be unified within our ED-EDA framework by applying three different eigenvalue tuning strategies. The effects of eigenvalue on influencing the evolution are investigated through combining maximum likelihood estimates of Gaussian model with each of the eigenvalue tuning strategies in ED-EDA. In our experiments, proper eigenvalue tunings show high efficiency in solving problems with small population sizes, which are difficult for classical MGEDA adopting maximum likelihood estimates alone. Previously developed covariance matrix repairing (CMR) methods focusing on repairing computational errors of covariance matrix can be seen as a special eigenvalue tuning strategy. By using the ED-EDA framework, the computational time of CMR methods can be reduced from cubic to linear. Two new efficient CMR methods are proposed. Through explicitly tuning eigenvalues, ED-EDA provides a new approach to develop more efficient Gaussian based EDAs. © 2008 Elsevier Inc. All rights reserved.
Original languageEnglish
Pages (from-to)3000-3023
Number of pages24
JournalInformation Sciences
Issue number15
Early online date15 Feb 2008
Publication statusPublished - Aug 2008
Externally publishedYes

Bibliographical note

The authors are grateful to reviewers for their constructive comments and to Gongqing Zhang for his help to improve the paper, and to Felicity Simon for her proof-reading. This work is partially supported by a grant from the Chinese Academy of Sciences for Outstanding Young Scholars from Overseas (No. 2F03B01) and a grant from EPSRC (EP/D052785/1).


  • Covariance matrix scaling
  • Eigen analysis
  • Eigenvalue tuning
  • Estimation of distribution algorithm
  • Multivariate Gaussian distribution


Dive into the research topics of 'Unified eigen analysis on multivariate Gaussian based estimation of distribution algorithms'. Together they form a unique fingerprint.

Cite this