Split-AE: An Autoencoder-based Disentanglement Framework for 3D Shape-to-shape Feature Transfer

Sneha SAHA, Leandro L. MINKU, Xin YAO, Bernhard SENDHOFF, Stefan MENZEL

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Researchpeer-review

1 Citation (Scopus)

Abstract

Recent advancements in machine learning comprise generative models such as autoencoders (AE) for learning and compressing 3D data to generate low-dimensional latent representations of 3D shapes. Learning latent representations that disentangle the underlying factors of variations in 3D shapes is an intuitive way to achieve generalization in generative models. However, it remains an open problem to learn a generative model of 3D shapes such that the latent variables are disentangled and represent different interpretable aspects of 3D shapes. In this paper, we propose Split-AE, which is an autoencoder-based architecture for partitioning the latent space into two sets, named as content and style codes. The content code represents global features of 3D shapes to differentiate between semantic categories of shapes, while style code represents distinct visual features to differentiate between shape categories having similar semantic meaning. We present qualitative and quantitative experiments to verify feature disentanglement using our Split-AE. Further, we demonstrate that, given a source shape as an initial shape and a target shape as a style reference, the trained Split-AE combines the content of a source and style of a target shape to generate a novel augmented shape, that possesses the distinct features of the target shape category yet maintains the similarity of the global features with the source shape. We conduct a qualitative study showing that the augmented shapes exhibit a realistic interpretable mixture of content and style features across different shape classes with similar semantic meaning. © 2022 IEEE.
Original languageEnglish
Title of host publicationProceedings of the International Joint Conference on Neural Networks
PublisherInstitute of Electrical and Electronics Engineers Inc.
Volume2022-July
ISBN (Print)9781728186719
DOIs
Publication statusPublished - 18 Jul 2022
Externally publishedYes

Keywords

  • autoencoders
  • feature disentanglement
  • point clouds
  • Shape analysis

Fingerprint

Dive into the research topics of 'Split-AE: An Autoencoder-based Disentanglement Framework for 3D Shape-to-shape Feature Transfer'. Together they form a unique fingerprint.

Cite this