Abstract
As a novel paradigm for data mining and dimensionality reduction, Non-negative Matrix Tri-Factorization (NMTF) has attracted much attention due to its notable performance and elegant mathematical derivation, and it has been applied to a plethora of real-world applications, such as text data co-clustering. However, the existing NMTF-based methods usually involve intensive matrix multiplications, which exhibits a major limitation of high computational complexity. With the explosion at both the size and the feature dimension of texts, there is a growing need to develop a parallel and scalable NMTF-based algorithm for text data co-clustering. To this end, we first show in this paper how to theoretically derive the original optimization problem of NMTF by introducing the Lagrangian multipliers. Then, we propose to solve the Lagrange dual objective function in parallel through an efficient distributed implementation. Extensive experiments on five benchmark corpora validate the effectiveness, efficiency, and scalability of our distributed parallel update algorithm for an NMTF-based text data co-clustering method.
Original language | English |
---|---|
Journal | IEEE Transactions on Knowledge and Data Engineering |
DOIs | |
Publication status | E-pub ahead of print - 31 Jan 2022 |
Bibliographical note
Guangdong Basic and Applied Basic Research Foundation (Grant Number: 2020A1515010536); 10.13039/501100001809-National Natural Science Foundation of China (Grant Number: 61972426)Publisher Copyright:
IEEE
Keywords
- Non-negative matrix tri-factorization
- parallel computing
- message passing
- Newton iteration
- Computational modeling
- Scalability
- Data models
- Partitioning algorithms
- Matrix decomposition
- Optimization
- Convergence