The random k-labelsets ensemble (RAkEL) is a multi-label learning strategy that integrates many single-label learning models. Each single-label model is constructed using a label powerset (LP) technique based on a randomly generated size-k label subset. Although RAkEL can improve the generalization capability and reduce the complexity of the original LP method, the quality of the randomly generated label subsets could be low. On the one hand, the transformed classes may be difficult to separate in the feature space, negatively affecting the performance; on the other hand, the classes might be highly imbalanced, resulting in difficulties in using the existing single-label algorithms. To solve these problems, we propose an active k-labelsets ensemble (ACkEL) paradigm. Borrowing the idea of active learning, a label-selection criterion is proposed to evaluate the separability and balance level of the classes transformed from a label subset. Subsequently, by randomly selecting the first label or label subset, the remaining ones are iteratively chosen based on the proposed criterion. ACkEL can be realized in both the disjoint and overlapping modes, which adopt pool-based and stream-based frameworks, respectively. Experimental comparisons demonstrate the feasibility and effectiveness of the proposed methods.
Bibliographical noteThis work was supported in part by the National Natural Science Foundation of China (Grants 61772344, 61811530324, 61732011, 61871270, and 61402460 ), in part by the HD Video R&D Platform for Intelligent Analysis and Processing in Guangdong Engineering Technology Research Centre of Colleges and Universities (Grant GCZX-A1409), in part by the Natural Science Foundation of Shenzhen (Grant JCYJ20170818091621856), in part by the Natural Science Foundation of SZU (Grants 827-000140 and 827-000230), and in part by the Interdisciplinary Innovation Team of Shenzhen University.
- k-Labelsets Ensemble
- Label powerset
- Multi-label learning