Abstract
This study investigates the application of genetic algorithms (GA) for hyperparameter optimization in machine learning models, including Logistic Regression, Random For-est, Support Vector Machine (SVM), XGBoost, and Multilayer Perceptron (MLP). The performance of models with default settings, optimized using grid search, and optimized using GA is compared using the F1 macro score on the 'Heart Disease' dataset from the UCI Machine Learning Repository. The results demonstrate that hyperparameter optimization, both through grid search and GA, generally improves model performance compared to default configurations. GA optimization consistently outperforms or matches grid search performance for all models tested. For GA-optimized MLP, a specialized initialization mechanism, crossover, and mutation operators are introduced to optimize both network structure and hyperparameters. The best GA-optimized MLP achieves the highest F1 macro score of 87% among all experiments, surpassing both default and grid search optimized models. The study highlights the potential of GA for automating hyperparameter tuning, efficiently exploring the search space, and finding near-optimal configurations. As the complexity of machine learning models grows, evolutionary algorithms like GA are likely to become increasingly important for hyperparameter optimization in the field of machine learning.
| Original language | English |
|---|---|
| Title of host publication | 2024 6th International Academic Exchange Conference on Science and Technology Innovation, IAECST 2024: Proceedings |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| Pages | 877-888 |
| Number of pages | 12 |
| ISBN (Electronic) | 9798331507138 |
| DOIs | |
| Publication status | Published - 2024 |
| Externally published | Yes |
| Event | 2024 6th International Academic Exchange Conference on Science and Technology Innovation, IAECST 2024 - Guangzhou, China Duration: 6 Dec 2024 → 8 Dec 2024 |
Conference
| Conference | 2024 6th International Academic Exchange Conference on Science and Technology Innovation, IAECST 2024 |
|---|---|
| Abbreviated title | IAECST 2024 |
| Country/Territory | China |
| City | Guangzhou |
| Period | 6/12/24 → 8/12/24 |
Bibliographical note
Publisher Copyright:© 2024 IEEE.
UN SDGs
This output contributes to the following UN Sustainable Development Goals (SDGs)
-
SDG 3 Good Health and Well-being
Keywords
- Deep Neural Networks
- Genetic Algorithms
- Heart Disease
- Machine Learning
- Multi-layer Preceptron
Fingerprint
Dive into the research topics of 'Optimizing ML and DNN by Genetic Algorithms'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver