Graph Neural Network contextual embedding for Deep Learning on tabular data.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

All industries are trying to leverage Artificial Intelligence (AI) based on their existing big data which is available in so called tabular form, where each record is composed of a number of heterogeneous continuous and categorical columns also known as features. Deep Learning (DL) has constituted a major breakthrough for AI in fields related to human skills like natural language processing, but its applicability to tabular data has been more challenging. More classical Machine Learning (ML) models like tree-based ensemble ones usually perform better. This paper presents a novel DL model using Graph Neural Network (GNN) more specifically Interaction Network (IN), for contextual embedding and modeling interactions among tabular features. Its results outperform those of a recently published survey with DL benchmark based on seven public datasets, also achieving competitive results when compared to boosted-tree solutions.

Authors

  • Mario Villaizán-Vallelado
    Artificial Intelligence Laboratory (AI-Lab), Telefonica I+D, Spain; Universidad de Valladolid, Valladolid, 47011, Spain. Electronic address: mario.villaizan@uva.es.
  • Matteo Salvatori
    Artificial Intelligence Laboratory (AI-Lab), Telefonica I+D, Spain. Electronic address: matteo.salvatori@telefonica.com.
  • Belén Carro
    Universidad de Valladolid, Valladolid, 47011, Spain. Electronic address: belen.carro@uva.es.
  • Antonio Javier Sanchez-Esguevillas
    Universidad de Valladolid, Valladolid, 47011, Spain. Electronic address: antoniojavier.sanchez@uva.es.