Differential-Critic GAN: Generating What You Want by a Cue of Preferences

Yinghua YAO, Yuangang PAN, Ivor W. TSANG, Xin YAO

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

This article proposes differential-critic generative adversarial network (DiCGAN) to learn the distribution of user-desired data when only partial instead of the entire dataset possesses the desired property. DiCGAN generates desired data that meet the user’s expectations and can assist in designing biological products with desired properties. Existing approaches select the desired samples first and train regular GANs on the selected samples to derive the user-desired data distribution. However, the selection of the desired data relies on global knowledge and supervision over the entire dataset. DiCGAN introduces a differential critic that learns from pairwise preferences, which are local knowledge and can be defined on a part of training data. The critic is built by defining an additional ranking loss over the Wasserstein GAN’s critic. It endows the difference of critic values between each pair of samples with the user preference and guides the generation of the desired data instead of the whole data. For a more efficient solution to ensure data quality, we further reformulate DiCGAN as a constrained optimization problem, based on which we theoretically prove the convergence of our DiCGAN. Extensive experiments on a diverse set of datasets with various applications demonstrate that our DiCGAN achieves state-of-the-art performance in learning the user-desired data distributions, especially in the cases of insufficient desired data and limited supervision. IEEE
Original languageEnglish
Pages (from-to)1-15
Number of pages15
JournalIEEE Transactions on Neural Networks and Learning Systems
DOIs
Publication statusPublished - 2022
Externally publishedYes

Funding

The work of Yinghua Yao and Xin Yao was supported in part by the Program for Guangdong Introducing Innovative and Entrepreneurial Teams under Grant 2017ZT07X386, in part by the Shenzhen Science and Technology Program under Grant KQTD2016112514355531, and in part by the Program for Guangdong Provincial Key Laboratory under Grant 2020B121201001. The work of Yuangang Pan was supported in part by the A*STAR Career Development Fund (CDF) 2022 and in part by the A*STAR Centre for Frontier AI Research. The work of Ivor W. Tsang was supported in part by the A*STAR Centre for Frontier AI Research and in part by the Australian Research Council under Grant DP200101328.

Keywords

  • Desired data generation
  • generative adversarial network (GAN)
  • Generative adversarial networks
  • Generators
  • Knowledge engineering
  • Labeling
  • pairwise ranking
  • Robots
  • Training
  • Training data
  • user preference

Fingerprint

Dive into the research topics of 'Differential-Critic GAN: Generating What You Want by a Cue of Preferences'. Together they form a unique fingerprint.

Cite this