SBTM : topic modeling over short texts

Jianhui PANG, Xiangsheng LI, Haoran XIE, Yanghui RAO*

*Corresponding author for this work

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)

4 Citations (Scopus)

Abstract

With the rapid development of social media services such as Twitter, Sina Weibo and so forth, short texts are becoming more and more prevalent. However, inferring topics from short texts is always full of challenges for many content analysis tasks because of the sparsity of word co-occurrence patterns in short texts. In this paper, we propose a classification model named sentimental biterm topic model (SBTM), which is applied to sentiment classification over short texts. To alleviate the problem of sparsity in short texts, the similarity between words and documents are firstly estimated by singular value decomposition. Then, the most similar words are added to each short document in the corpus. Extensive evaluations on sentiment detection of short text validate the effectiveness of the proposed method.

Original languageEnglish
Title of host publicationDatabase Systems for Advanced Applications - DASFAA 2016 International Workshops, BDMS, BDQM, MoI, and SeCoP, Proceedings
EditorsJinho KIM, Hong GAO, Yasushi SAKURAI
Place of PublicationSwitzerland
PublisherSpringer-Verlag GmbH and Co. KG
Pages43-56
Number of pages14
ISBN (Print)9783319320540
DOIs
Publication statusPublished - 2016
Externally publishedYes
Event21st International Conference on Database Systems for Advanced Applications - University of Texas at Dallas, Dallas, United States
Duration: 16 Apr 201619 Apr 2016
https://theory.utdallas.edu/DASFAA2016/

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer
Volume9645
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st International Conference on Database Systems for Advanced Applications
Abbreviated titleDASFAA 2016
CountryUnited States
CityDallas
Period16/04/1619/04/16
Internet address

Keywords

  • Biterm topic model
  • Sentiment detection
  • Short text classification
  • Topic-based similarity

Fingerprint Dive into the research topics of 'SBTM : topic modeling over short texts'. Together they form a unique fingerprint.

  • Cite this

    PANG, J., LI, X., XIE, H., & RAO, Y. (2016). SBTM : topic modeling over short texts. In J. KIM, H. GAO, & Y. SAKURAI (Eds.), Database Systems for Advanced Applications - DASFAA 2016 International Workshops, BDMS, BDQM, MoI, and SeCoP, Proceedings (pp. 43-56). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9645). Springer-Verlag GmbH and Co. KG. https://doi.org/10.1007/978-3-319-32055-7_4