A learning framework for information block search based on probabilistic graphical models and Fisher Kernel

Tak-Lam WONG*, Haoran XIE, Wai LAM, Fu Lee WANG

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)

Abstract

Contrary to traditional Web information retrieval methods that can only return a ranked list of Web pages and only allow search terms in the query, we have developed a novel learning framework for retrieving precise information blocks from Web pages given a query, which may contain some search terms and prior information such as the layout format of the data. There are two challenging sub-tasks for this problem. One challenge is information block detection, where a Web page is automatically segmented into blocks. Another challenge is to find the information blocks relevant to the query. Existing page segmentation methods, which make use of only visual layout information or only content information, do not consider the query information, leading to a solution having conflict with the information need expressed by the query. Our framework aims at modeling the query and the block features to capture both keyword information and prior information via a probabilistic graphical model. Fisher Kernel, which can effectively incorporate the graphical model, is then employed to accomplish the two sub-tasks in a unified manner, optimizing the final goal of block retrieval performance. We have conducted experiments on benchmark datasets and read-world data. Comparisons between existing methods have been conducted to evaluate the effectiveness of our framework.

Original languageEnglish
Pages (from-to)1473-1487
Number of pages15
JournalInternational Journal of Machine Learning and Cybernetics
Volume9
Issue number9
Early online date28 Mar 2017
DOIs
Publication statusPublished - Sep 2018
Externally publishedYes

Bibliographical note

The work described in this paper was partially supported by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China (Project No. 14203414 and Project No. UGC/FDS11/E06/14).

Keywords

  • Fisher Kernel
  • Graphical models
  • Information block retrieval
  • Information extraction

Fingerprint Dive into the research topics of 'A learning framework for information block search based on probabilistic graphical models and Fisher Kernel'. Together they form a unique fingerprint.

  • Cite this