A study on pharmaceutical text relationship extraction based on heterogeneous graph neural networks
Shuilong Zou, Zhaoyang Liu, Kaiqi Wang et al. · Mathematical Biosciences & Engineering · 2023
Effective information extraction of pharmaceutical texts is of great significance for clinical research. The ancient Chinese medicine text has streamlined sentences and complex semantic relationships, and the textual relationships may exist between heterogeneous entities. The current mainstream relationship extraction model does not take into account the associations between entities and relationships when extracting, resulting in insufficient semantic information to form an effective structured representation. In this paper, we propose a heterogeneous graph neural network relationship extraction model adapted to traditional Chinese medicine (TCM) text. First, the given sentence and predefined relationships are embedded by bidirectional encoder representation from transformers (BERT fine-tuned) word embedding as model input. Second, a heterogeneous graph network is constructed to associate words, phrases, and relationship nodes to obtain the hidden layer representation. Then, in the decoding stage, two-stage subject-object entity identification method is adopted, and the identifier adopts a binary classifier to locate the start and end positions of the TCM entities, identifying all the subject-object entities in the sentence, and finally forming the TCM entity relationship group. Through the experiments on the TCM relationship extraction dataset, the results show that the precision value of the heterogeneous graph neural network embedded with BERT is 86.99% and the F1 value reaches 87.40%, which is improved by 8.83% and 10.21% compared with the relationship extraction models CNN, Bert-CNN, and Graph LSTM.
Cited by 1 works. doi:10.3934/mbe.2024064 Open-access PDF
Authors
References
- BioBERT: a pre-trained biomedical language representation model for biomedical text mining
- Neural Relation Extraction with Selective Attention over Instances
- Integrative mining of traditional Chinese medicine literature and MEDLINE for functional gene networks
- Exploiting syntactic and semantics information for chemical–disease relation extraction
- A hybrid model based on neural networks for biomedical relation extraction
- A neural network-based joint learning approach for biomedical entity and relation extraction from biomedical literature
- A BERT based dual-channel explainable text emotion recognition system
- End-to-End syndrome differentiation of Yin deficiency and Yang deficiency in traditional Chinese medicine
- MRGAT: Multi-Relational Graph Attention Network for knowledge graph completion
- Quantitative knowledge presentation models of traditional Chinese medicine (TCM): A review