Skip to main navigation Skip to search Skip to main content

Optimizing ML and DNN by Genetic Algorithms

  • Zihao DONGFANG
  • , Tenglong ZENG

Research output: Book Chapters | Papers in Conference Proceedings › Conference paper (refereed) › Referred Conference Paper › peer-review

Abstract

This study investigates the application of genetic algorithms (GA) for hyperparameter optimization in machine learning models, including Logistic Regression, Random For-est, Support Vector Machine (SVM), XGBoost, and Multilayer Perceptron (MLP). The performance of models with default settings, optimized using grid search, and optimized using GA is compared using the F1 macro score on the 'Heart Disease' dataset from the UCI Machine Learning Repository. The results demonstrate that hyperparameter optimization, both through grid search and GA, generally improves model performance compared to default configurations. GA optimization consistently outperforms or matches grid search performance for all models tested. For GA-optimized MLP, a specialized initialization mechanism, crossover, and mutation operators are introduced to optimize both network structure and hyperparameters. The best GA-optimized MLP achieves the highest F1 macro score of 87% among all experiments, surpassing both default and grid search optimized models. The study highlights the potential of GA for automating hyperparameter tuning, efficiently exploring the search space, and finding near-optimal configurations. As the complexity of machine learning models grows, evolutionary algorithms like GA are likely to become increasingly important for hyperparameter optimization in the field of machine learning.
Original languageEnglish
Title of host publication2024 6th International Academic Exchange Conference on Science and Technology Innovation, IAECST 2024: Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages877-888
Number of pages12
ISBN (Electronic)9798331507138
DOIs
Publication statusPublished - 2024
Externally publishedYes
Event2024 6th International Academic Exchange Conference on Science and Technology Innovation, IAECST 2024 - Guangzhou, China
Duration: 6 Dec 2024 → 8 Dec 2024

Conference

Conference2024 6th International Academic Exchange Conference on Science and Technology Innovation, IAECST 2024
Abbreviated title IAECST 2024
Country/TerritoryChina
CityGuangzhou
Period6/12/24 → 8/12/24

Bibliographical note

Publisher Copyright:
© 2024 IEEE.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Keywords

  • Deep Neural Networks
  • Genetic Algorithms
  • Heart Disease
  • Machine Learning
  • Multi-layer Preceptron

Fingerprint

Dive into the research topics of 'Optimizing ML and DNN by Genetic Algorithms'. Together they form a unique fingerprint.

Cite this