Multi-criteria decision making based architecture selection for single-hidden layer feedforward neural networks

Ran WANG*, Haoran XIE, Jiqiang FENG, Fu Lee WANG, Chen XU

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)

4 Citations (Scopus)

Abstract

Architecture selection is a fundamental problem in artificial neural networks, which could be treated as a decision making process that evaluates, ranks, and makes choices from a set of network structures. Traditional methods evaluate a network structure by designing a criterion based on a validation model or an error bound model. On one hand, the time complexity of a validation model is usually high; on the other hand, different validation models or error bound models may lead to different (even conflicting) results, which post challenges to the traditional single criterion-based architecture selection methods. In the area of decision making, many problems employed multiple criteria since the performance is better than using a single criterion. In this paper, we propose a multi-criteria decision making based architecture selection algorithm for single-hidden layer feedforward neural networks trained by extreme learning machine. Two criteria are incorporated into the selection process, i.e., training accuracy and the Q-value estimated by the localized generalization error model. The training accuracy reflects the capability of the model on correctly categorizing the known samples, and the Q-value estimated by localized generalization error model reflects the size of the neighbourhood of training samples in which the model can predict unseen samples with confidence. By achieving a trade-off between these two criteria, a new architecture selection algorithm is proposed. Experimental comparisons demonstrate the feasibility and effectiveness of the proposed method.

Original languageEnglish
Pages (from-to)655-666
Number of pages12
JournalInternational Journal of Machine Learning and Cybernetics
Volume10
Issue number4
Early online date18 Nov 2017
DOIs
Publication statusPublished - 2 Apr 2019
Externally publishedYes

Bibliographical note

This work was supported in part by the National Natural Science Foundation of China under Grant 61772344, Grant 61402460, Grant 61732011, and Grant 61472257, in part by the Natural Science Foundation of SZU under Grant 2017060, in part by the Guangdong Provincial Science and Technology Plan Project under Grant 2013B040403005, in part by the HD Video R&D Platform for Intelligent Analysis and Processing in Guangdong Engineering Technology Research Centre of Colleges and Universities under Grant GCZX-A1409, in part by the Internal Research Grant (RG 66/2016-2017) of The Education University of Hong Kong, and in part by a grant from Research Grants Council of Hong Kong Special Administrative Region, China (UGC/FDS11/E04/16).

Keywords

  • Architecture selection
  • Extreme learning machine
  • Localized generalization error model
  • Multi-criteria decision making

Fingerprint Dive into the research topics of 'Multi-criteria decision making based architecture selection for single-hidden layer feedforward neural networks'. Together they form a unique fingerprint.

Cite this