An evolutionary multi-objective optimization framework of discretization-based feature selection for classification

Yu ZHOU, Junhao KANG, Sam KWONG, Xu WANG, Qingfu ZHANG

Research output: Journal PublicationsJournal Article (refereed)peer-review

42 Citations (Scopus)

Abstract

Feature selection (FS) aims to identify the most relevant and non-redundant feature subset for improving the classification accuracy, which is regarded as a NP-hard problem. Some heuristic methods, such as particle swarm optimization (PSO) have achieved great success, however, with the increase of feature quantity, the solution space is too large, resulting in lower search efficiency. Recent discretization-based FS methods map the search of feature domain into cut-point domain, which shrinks the solution space and improve the performances significantly. In this paper, considering the conflicts between different objectives, we proposed an evolutionary multi-objective optimization framework for discretization-based FS. To obtain the Pareto solutions, a flexible cut-point PSO (FCPSO) which can select an arbitrary number of cut-points for discretization is introduced to help better explore the relevant features. In FCPSO, a particle update and a novel adaptive mutation operator are alternatively used to effectively find the relevant features and remove the redundant features. At last, to select the best feature subset, a Pareto ensemble method is designed to generate a number of feasible solutions based on Pareto set followed by a hierarchical solution selection process. We implemented the proposed framework by using three representative multi-objective evolutionary algorithms and compared them with some state-of-the-art methods. Experimental results on ten benchmark microarray gene datasets demonstrate that our proposed framework significantly outperforms other methods in terms of test classification accuracy with a competitive size of feature subset.
Original languageEnglish
Article number100770
JournalSwarm and Evolutionary Computation
Volume60
Early online date16 Sept 2020
DOIs
Publication statusPublished - Feb 2021
Externally publishedYes

Bibliographical note

This work is supported in part by the Natural Science Foundation of China under Grants 61702336 and 61871270, in part by Shenzhen Emerging Industries of the Strategic Basic Research Project JCYJ20170302154254147, and in part by Natural Science Foundation of SZU (grants no. 2018068 and no. 2018057).

Keywords

  • Discretization
  • Evolutionary multi-objective algorithms
  • Feature selection
  • Pareto ensemble
  • Particle swarm optimization

Fingerprint

Dive into the research topics of 'An evolutionary multi-objective optimization framework of discretization-based feature selection for classification'. Together they form a unique fingerprint.

Cite this