Skip to main navigation Skip to search Skip to main content

PCE-GAN: A Generative Adversarial Network for Point Cloud Attribute Quality Enhancement Based on Optimal Transport

  • Tian GUO
  • , Hui YUAN*
  • , Qi LIU
  • , Honglei SU
  • , Raouf HAMZAOUI
  • , Sam KWONG
  • *Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

Point cloud compression significantly reduces data volume but sacrifices reconstruction quality, highlighting the need for advanced quality enhancement techniques. Most existing approaches focus primarily on point-to-point fidelity, often neglecting the importance of perceptual quality as interpreted by the human visual system. To address this issue, we propose a generative adversarial network for point cloud quality enhancement (PCE-GAN), grounded in optimal transport theory, with the goal of simultaneously optimizing both data fidelity and perceptual quality. The generator consists of a local feature extraction (LFE) unit, a global spatial correlation (GSC) unit and a feature squeeze unit. The LFE unit uses dynamic graph construction and a graph attention mechanism to efficiently extract local features, placing greater emphasis on points with severe distortion. The GSC unit uses the geometry information of neighboring patches to construct an extended local neighborhood and introduces a transformer-style structure to capture long-range global correlations. The discriminator computes the deviation between the probability distributions of the enhanced point cloud and the original point cloud, guiding the generator to achieve high quality reconstruction. Experimental results show that the proposed method achieves state-of-the-art performance. Specifically, when applying PCE-GAN to the latest geometry-based point cloud compression (G-PCC) test model, it achieves an average BD-rate of -19.2% compared with the PredLift coding configuration and -18.3% compared with the RAHT coding configuration. Subjective comparisons show a significant improvement in texture clarity and color transitions, revealing finer details and more natural color gradients.
Original languageEnglish
Pages (from-to)6138-6151
Number of pages14
JournalIEEE Transactions on Image Processing
Volume34
Early online date23 Sept 2025
DOIs
Publication statusPublished - 2025

Bibliographical note

Publisher Copyright:
© 1992-2012 IEEE.

Funding

This work was supported in part by the National Natural Science Foundation of China under Grant 62222110, Grant 62571303, Grant 62172259, and Grant 62311530104; in part by the High-End Foreign Experts Recruitment Plan of Chinese Ministry of Science and Technology under Grant G2023150003L; in part by Taishan Scholar Project of Shandong Province under Grant tsqn202103001; in part by the Natural Science Foundation of Shandong Province under Grant ZR2022ZD38; and in part by the OPPO Research Fund.

Keywords

  • Point cloud compression
  • attribute compression
  • quality enhancement
  • G-PCC
  • point cloud

Fingerprint

Dive into the research topics of 'PCE-GAN: A Generative Adversarial Network for Point Cloud Attribute Quality Enhancement Based on Optimal Transport'. Together they form a unique fingerprint.

Cite this