Probabilistic Semi-Supervised Learning via Sparse Graph Structure Learning

Li WANG*, Raymond CHAN, Tieyong ZENG

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

11 Citations (Scopus)

Abstract

We present a probabilistic semi-supervised learning (SSL) framework based on sparse graph structure learning. Different from existing SSL methods with either a predefined weighted graph heuristically constructed from the input data or a learned graph based on the locally linear embedding assumption, the proposed SSL model is capable of learning a sparse weighted graph from the unlabeled high-dimensional data and a small amount of labeled data, as well as dealing with the noise of the input data. Our representation of the weighted graph is indirectly derived from a unified model of density estimation and pairwise distance preservation in terms of various distance measurements, where latent embeddings are assumed to be random variables following an unknown density function to be learned, and pairwise distances are then calculated as the expectations over the density for the model robustness to the data noise. Moreover, the labeled data based on the same distance representations are leveraged to guide the estimated density for better class separation and sparse graph structure learning. A simple inference approach for the embeddings of unlabeled data based on point estimation and kernel representation is presented. Extensive experiments on various data sets show promising results in the setting of SSL compared with many existing methods and significant improvements on small amounts of labeled data.

Original languageEnglish
Article number9063663
Pages (from-to)853-867
Number of pages15
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume32
Issue number2
DOIs
Publication statusPublished - Feb 2021
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2012 IEEE.

Keywords

  • Graph structure learning
  • kernel learning
  • latent variable model
  • semi-supervised learning (SSL)

Fingerprint

Dive into the research topics of 'Probabilistic Semi-Supervised Learning via Sparse Graph Structure Learning'. Together they form a unique fingerprint.

Cite this