Architecture selection is a fundamental problem in artificial neural networks, which could be treated as a decision making process that evaluates, ranks, and makes choices from a set of network structures. Traditional methods evaluate a network structure by designing a criterion based on a validation model or an error bound model. On one hand, the time complexity of a validation model is usually high; on the other hand, different validation models or error bound models may lead to different (even conflicting) results, which post challenges to the traditional single criterion-based architecture selection methods. In the area of decision making, many problems employed multiple criteria since the performance is better than using a single criterion. In this paper, we propose a multi-criteria decision making based architecture selection algorithm for single-hidden layer feedforward neural networks trained by extreme learning machine. Two criteria are incorporated into the selection process, i.e., training accuracy and the Q-value estimated by the localized generalization error model. The training accuracy reflects the capability of the model on correctly categorizing the known samples, and the Q-value estimated by localized generalization error model reflects the size of the neighbourhood of training samples in which the model can predict unseen samples with confidence. By achieving a trade-off between these two criteria, a new architecture selection algorithm is proposed. Experimental comparisons demonstrate the feasibility and effectiveness of the proposed method.
|Number of pages||12|
|Journal||International Journal of Machine Learning and Cybernetics|
|Early online date||18 Nov 2017|
|Publication status||Published - 2 Apr 2019|
Bibliographical noteThis work was supported in part by the National Natural Science Foundation of China under Grant 61772344, Grant 61402460, Grant 61732011, and Grant 61472257, in part by the Natural Science Foundation of SZU under Grant 2017060, in part by the Guangdong Provincial Science and Technology Plan Project under Grant 2013B040403005, in part by the HD Video R&D Platform for Intelligent Analysis and Processing in Guangdong Engineering Technology Research Centre of Colleges and Universities under Grant GCZX-A1409, in part by the Internal Research Grant (RG 66/2016-2017) of The Education University of Hong Kong, and in part by a grant from Research Grants Council of Hong Kong Special Administrative Region, China (UGC/FDS11/E04/16).
- Architecture selection
- Extreme learning machine
- Localized generalization error model
- Multi-criteria decision making