Parallel non-negative matrix tri-factorization for text data co-clustering

Yufu CHEN, Zhiqi LEI, Yanghui RAO, Haoran XIE, Fu Lee WANG, Jian YIN, Qing LI

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

As a novel paradigm for data mining and dimensionality reduction, Non-negative Matrix Tri-Factorization (NMTF) has attracted much attention due to its notable performance and elegant mathematical derivation, and it has been applied to a plethora of real-world applications, such as text data co-clustering. However, the existing NMTF-based methods usually involve intensive matrix multiplications, which exhibits a major limitation of high computational complexity. With the explosion at both the size and the feature dimension of texts, there is a growing need to develop a parallel and scalable NMTF-based algorithm for text data co-clustering. To this end, we first show in this paper how to theoretically derive the original optimization problem of NMTF by introducing the Lagrangian multipliers. Then, we propose to solve the Lagrange dual objective function in parallel through an efficient distributed implementation. Extensive experiments on five benchmark corpora validate the effectiveness, efficiency, and scalability of our distributed parallel update algorithm for an NMTF-based text data co-clustering method.
Original languageEnglish
JournalIEEE Transactions on Knowledge and Data Engineering
DOIs
Publication statusE-pub ahead of print - 31 Jan 2022

Bibliographical note

Guangdong Basic and Applied Basic Research Foundation (Grant Number: 2020A1515010536); 10.13039/501100001809-National Natural Science Foundation of China (Grant Number: 61972426)

Publisher Copyright:
IEEE

Keywords

  • Non-negative matrix tri-factorization
  • parallel computing
  • message passing
  • Newton iteration
  • Computational modeling
  • Scalability
  • Data models
  • Partitioning algorithms
  • Matrix decomposition
  • Optimization
  • Convergence

Fingerprint

Dive into the research topics of 'Parallel non-negative matrix tri-factorization for text data co-clustering'. Together they form a unique fingerprint.

Cite this