Evolving a Pipeline Approach for Abstract Meaning Representation Parsing Towards Dynamic Neural Networks.

Journal: International journal of neural systems
PMID:

Abstract

Meaning Representation parsing aims to represent a sentence as a structured, Directed, Acyclic Graph (DAG), in an attempt to extract meaning from text. This paper extends an existing 2-stage pipeline AMR parser with state-of-the-art techniques in dependency parsing. First, Pointer-Generator Networks are used for out-of-vocabulary words in the concept identification stage, with an improved initialization via the use of word-and character-level embeddings. Second, the performance of the Relation Identification module is improved by jointly training the Heads Selection and the Arcs Labeling components. Last, we underline the difficulty of end-to-end training with recurrent modules in a static deep neural network construction approach and explore a dynamic construction implementation, which continuously adapts the computation graph, thus potentially enabling end-to-end training in the proposed pipeline solution.

Authors

  • Florin Macicasan
    Knowledge Engineering Research Group, Technical University of Cluj-Napoca, Cluj-Napoca 400027, Romania.
  • Alexandru Frasie
    Knowledge Engineering Research Group, Technical University of Cluj-Napoca, Cluj-Napoca 400027, Romania.
  • Nicoleta-Teodora Vezan
    Knowledge Engineering Research Group, Technical University of Cluj-Napoca, Cluj-Napoca 400027, Romania.
  • Camelia Lemnaru
    Department of Computer Science, Technical University of Cluj-Napoca, 26-28 G. Baritiu, 400027 Cluj-Napoca, Romania.
  • Rodica Potolea
    Department of Computer Science, Technical University of Cluj-Napoca, 26-28 G. Baritiu, 400027 Cluj-Napoca, Romania.