Automatic keyword extraction from documents using conditional random fields

Chengzhi ZHANG, Huilin WANG, Yao LIU, Dan WU, Yi LIAO, Bo WANG

Research output: Journal PublicationsJournal Article (refereed)

144 Citations (Scopus)

Abstract

Keywords are subset of words or phrases from a document that can describe the meaning of the document. Many text mining applications can take advantage from it. Unfortunately, a large portion of documents still do not have keywords assigned. On the other hand, manual assignment of high quality keywords is expensive, time-consuming, and error prone. Therefore, most algorithms and systems aimed to help people perform automatic keywords extraction have been proposed. Conditional Random Fields (CRF) model is a state-of-the-art sequence labeling method, which can use the features of documents more sufficiently and effectively. At the same time, keywords extraction can be considered as the string labeling. In this paper, keywords extraction based on CRF is proposed and implemented. As far as we know, using CRF model in keyword extraction has not been investigated previously. Experimental results show that the CRF model outperforms other machine learning methods such as support vector machine, multiple linear regression model etc. in the task of keywords extraction.
Original languageEnglish
Pages (from-to)1169-1180
Number of pages12
JournalJournal of Computational Information Systems
Volume4
Issue number3
Publication statusPublished - 1 Mar 2008
Externally publishedYes

Fingerprint Dive into the research topics of 'Automatic keyword extraction from documents using conditional random fields'. Together they form a unique fingerprint.

  • Cite this

    ZHANG, C., WANG, H., LIU, Y., WU, D., LIAO, Y., & WANG, B. (2008). Automatic keyword extraction from documents using conditional random fields. Journal of Computational Information Systems, 4(3), 1169-1180.