Joint Extraction of Entities and Relations Using Reinforcement Learning and Deep Learning.

Journal: Computational intelligence and neuroscience
Published Date:

Abstract

We use both reinforcement learning and deep learning to simultaneously extract entities and relations from unstructured texts. For reinforcement learning, we model the task as a two-step decision process. Deep learning is used to automatically capture the most important information from unstructured texts, which represent the state in the decision process. By designing the reward function per step, our proposed method can pass the information of entity extraction to relation extraction and obtain feedback in order to extract entities and relations simultaneously. Firstly, we use bidirectional LSTM to model the context information, which realizes preliminary entity extraction. On the basis of the extraction results, attention based method can represent the sentences that include target entity pair to generate the initial state in the decision process. Then we use Tree-LSTM to represent relation mentions to generate the transition state in the decision process. Finally, we employ -Learning algorithm to get control policy in the two-step decision process. Experiments on ACE2005 demonstrate that our method attains better performance than the state-of-the-art method and gets a 2.4% increase in recall-score.

Authors

  • Yuntian Feng
    Institute of Command Information System, PLA University of Science and Technology, Nanjing, Jiangsu 210007, China.
  • Hongjun Zhang
    Ministry of Agriculture, Institute for the Control of Agrochemicals, No. 22 Maizidian Street, Beijing 110000, China.
  • Wenning Hao
    Institute of Command Information System, PLA University of Science and Technology, Nanjing, Jiangsu 210007, China.
  • Gang Chen
    Department of Orthopedics, West China Hospital, Sichuan University, Chengdu, Sichuan, China.