A neural network multi-task learning approach to biomedical named entity recognition

Gamal CRICHTON*, Sampo PYYSALO, Billy CHIU, Anna KORHONEN

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

100 Citations (Scopus)

Abstract

Background: Named Entity Recognition (NER) is a key task in biomedical text mining. Accurate NER systems require task-specific, manually-annotated datasets, which are expensive to develop and thus limited in size. Since such datasets contain related but different information, an interesting question is whether it might be possible to use them together to improve NER performance. To investigate this, we develop supervised, multi-task, convolutional neural network models and apply them to a large number of varied existing biomedical named entity datasets. Additionally, we investigated the effect of dataset size on performance in both single- and multi-task settings. Results: We present a single-task model for NER, a Multi-output multi-task model and a Dependent multi-task model. We apply the three models to 15 biomedical datasets containing multiple named entities including Anatomy, Chemical, Disease, Gene/Protein and Species. Each dataset represent a task. The results from the single-task model and the multi-task models are then compared for evidence of benefits from Multi-task Learning. With the Multi-output multi-task model we observed an average F-score improvement of 0.8% when compared to the single-task model from an average baseline of 78.4%. Although there was a significant drop in performance on one dataset, performance improves significantly for five datasets by up to 6.3%. For the Dependent multi-task model we observed an average improvement of 0.4% when compared to the single-task model. There were no significant drops in performance on any dataset, and performance improves significantly for six datasets by up to 1.1%. The dataset size experiments found that as dataset size decreased, the multi-output model's performance increased compared to the single-task model's. Using 50, 25 and 10% of the training data resulted in an average drop of approximately 3.4, 8 and 16.7% respectively for the single-task model but approximately 0.2, 3.0 and 9.8% for the multi-task model. Conclusions: Our results show that, on average, the multi-task models produced better NER results than the single-task models trained on a single NER dataset. We also found that Multi-task Learning is beneficial for small datasets. Across the various settings the improvements are significant, demonstrating the benefit of Multi-task Learning for this task.

Original languageEnglish
Article number368
JournalBMC Bioinformatics
Volume18
Issue number1
DOIs
Publication statusPublished - 15 Aug 2017
Externally publishedYes

Bibliographical note

Funding Information:
This work was supported by Medical Research Council [grant number MR/M013049/1] and the Cambridge Commonwealth, European and International Trust.

Publisher Copyright:
© 2017 The Author(s).

Keywords

  • Biomedical text mining
  • Convolutional neural networks
  • Multi-task learning
  • Named entity recognition

Fingerprint

Dive into the research topics of 'A neural network multi-task learning approach to biomedical named entity recognition'. Together they form a unique fingerprint.

Cite this