Reproducibility and baseline reporting for dynamic multi-objective benchmark problems

Daniel HERRING, Michael KIRLEY, Xin YAO

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Researchpeer-review

3 Citations (Scopus)

Abstract

Dynamic multi-objective optimization problems (DMOPs) are widely accepted to be more challenging than stationary problems due to the time-dependent nature of the objective functions and/or constraints. Evaluation of purpose-built algorithms for DMOPs is often performed on narrow selections of dynamic instances with differing change magnitude and frequency or a limited selection of problems. In this paper, we focus on the reproducibility of simulation experiments for parameters of DMOPs. Our framework is based on an extension of PlatEMO, allowing for the reproduction of results and performance measurements across a range of dynamic settings and problems. A baseline schema for dynamic algorithm evaluation is introduced, which provides a mechanism to interrogate performance and optimization behaviours of well-known evolutionary algorithms that were not designed specifically for DMOPs. Importantly, by determining the maximum capability of non-dynamic multi-objective evolutionary algorithms, we can establish the minimum capability required of purpose-built dynamic algorithms to be useful. The simplest modifications to manage dynamic changes introduce diversity. Allowing non-dynamic algorithms to incorporate mutated/random solutions after change events determines the improvement possible with minor algorithm modifications. Future expansion to include current dynamic algorithms will enable reproduction of their results and verification of their abilities and performance across DMOP benchmark space.

Original languageEnglish
Title of host publicationGECCO 2022 - Proceedings of the 2022 Genetic and Evolutionary Computation Conference
PublisherAssociation for Computing Machinery, Inc
Pages529-537
Number of pages9
ISBN (Electronic)9781450392372
ISBN (Print)9781450392372
DOIs
Publication statusPublished - 8 Jul 2022
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2022 ACM.

Keywords

  • dynamic benchmarks
  • dynamic frequency and severity
  • dynamic multi-objective optimization
  • dynamic optimization
  • dynamic parameters

Fingerprint

Dive into the research topics of 'Reproducibility and baseline reporting for dynamic multi-objective benchmark problems'. Together they form a unique fingerprint.

Cite this