2D Gaussian Splatting for Image Compression

Pingping ZHANG, Xiangrui LIU, Meng WANG, Shiqi WANG*, Sam KWONG*

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

The implicit neural representation (INR) employed in image compression shows high decoding efficiency, yet it requires long encoding times due to the need for the model training tailored to the specific image being coded. Thus, we propose a new image compression scheme leveraging the 2D Gaussian splatting technique to accelerate encoding speed and maintain decoding efficiency. Specifically, we parameterize these Gaussians with key attributes including position, anisotropic covariance, color, and opacity coefficients, totaling 9 parameters per Gaussian. We initialize these Gaussians by sampling points from the image, followed by employing an αblending mechanism to determine the color values of each pixel. For compact attribute representation, we adopt a K-means based vector quantization approach for anisotropic covariance, color and opacity coefficients. Additionally, we introduce an adaptive dense control methodology to dynamically adjust Gaussian numbers, facilitating automatic point reduction or augmentation. Finally, the position, codebooks and indexes of other attributes are quantized and compressed by the lossless entropy coding. Our experimental evaluation demonstrates that our method achieves faster encoding speeds compared to other INR techniques while exhibiting comparable decoding speeds.

Original languageEnglish
Article numbere501
JournalAPSIPA Transactions on Signal and Information Processing
Volume13
Issue number6
DOIs
Publication statusPublished - 30 Oct 2024

Bibliographical note

Publisher Copyright:
© 2024 P. Zhang, X. Liu, M. Wang, S. Wang and S. Kwong.

Funding

This work was supported in part by the Hong Kong Innovation and Technology Commission (InnoHK Project CIMDA), in part by the General Research Fund of the Research Grant Council of Hong Kong under Grants 11209819, 11203820, and 11203220, in part by ITF Project GHP/044/21SZ, and in part by CityU Applied Research Grant 9667255.

Keywords

  • Gaussian splatting
  • image compression
  • vector quantization

Fingerprint

Dive into the research topics of '2D Gaussian Splatting for Image Compression'. Together they form a unique fingerprint.

Cite this