Bootstrapping social emotion classification with semantically rich hybrid neural networks

Xiangsheng LI, Yanghui RAO*, Haoran XIE, Raymond Yiu Keung LAU, Jian YIN, Fu Lee WANG

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

51 Citations (Scopus)

Abstract

Social emotion classification aims to predict the aggregation of emotional responses embedded in online comments contributed by various users. Such a task is inherently challenging because extracting relevant semantics from free texts is a classical research problem. Moreover, online comments are typically characterized by a sparse feature space, which makes the corresponding emotion classification task very difficult. On the other hand, though deep neural networks have been shown to be effective for speech recognition and image analysis tasks because of their capabilities of transforming sparse low-level features to dense high-level features, their effectiveness on emotion classification requires further investigation. The main contribution of our work reported in this paper is the development of a novel model of semantically rich hybrid neural network (HNN) which leverages unsupervised teaching models to incorporate semantic domain knowledge into the neural network to bootstrap its inference power and interpretability. To our best knowledge, this is the first successful work of incorporating semantics into neural networks to enhance social emotion classification and network interpretability. Through empirical studies based on three real-world social media datasets, our experimental results confirm that the proposed hybrid neural networks outperform other state-of-the-art emotion classification methods.

Original languageEnglish
Article number7953530
Pages (from-to)428-442
Number of pages15
JournalIEEE Transactions on Affective Computing
Volume8
Issue number4
Early online date19 Jun 2017
DOIs
Publication statusPublished - Oct 2017
Externally publishedYes

Funding

The research described in this paper was supported by the National Natural Science Foundation of China (61502545, 61472453, U1401256, U1501252, U1611264), the Internal Research Grant (RG 66/2016-2017) of The Education University of Hong Kong and a grant from Research Grants Council of Hong Kong Special Administrative Region, China (UGC/FDS11/E03/16). Lau's work was supported by grants from the Research Grants Council of the Hong Kong Special Administrative Region, China (Projects: CityU 11502115 and CityU 11525716), and the Shenzhen Municipal Science and Technology R&D Funding-Basic Research Program (Project No. JCYJ20160229165300897).

Keywords

  • hybrid neural network
  • Social emotion classification
  • sparse encoding
  • transfer learning

Fingerprint

Dive into the research topics of 'Bootstrapping social emotion classification with semantically rich hybrid neural networks'. Together they form a unique fingerprint.

Cite this