Different approaches for identifying important concepts in probabilistic biomedical text summarization

Milad Moradi, Nasser Ghadiri

Research output: Contribution to journalArticlepeer-review

Abstract

Automatic text summarization tools help users in the biomedical domain to acquire their intended information from various textual resources more efficiently. Some of biomedical text summarization systems put the basis of their sentence selection approach on the frequency of concepts extracted from the input text. However, it seems that exploring other measures rather than the raw frequency for identifying valuable contents within an input document, or considering correlations existing between concepts, may be more useful for this type of summarization. In this paper, we describe a Bayesian summarization method for biomedical text documents. The Bayesian summarizer initially maps the input text to the Unified Medical Language System (UMLS) concepts; then it selects the important ones to be used as classification features. We introduce six different feature selection approaches to identify the most important concepts of the text and select the most informative contents according to the distribution of these concepts. We show that with the use of an appropriate feature selection approach, the Bayesian summarizer can improve the performance of biomedical summarization. Using the Recall-Oriented Understudy for Gisting Evaluation (ROUGE) toolkit, we perform extensive evaluations on a corpus of scientific papers in the biomedical domain. The results show that when the Bayesian summarizer utilizes the feature selection methods that do not use the raw frequency, it can outperform the biomedical summarizers that rely on the frequency of concepts, domain-independent and baseline methods.
Original languageEnglish
Pages (from-to)101-116
Number of pages16
JournalArtificial Intelligence in Medicine
Volume84
DOIs
Publication statusPublished - 2018

Fingerprint

Dive into the research topics of 'Different approaches for identifying important concepts in probabilistic biomedical text summarization'. Together they form a unique fingerprint.

Cite this