Learning to solve combinatorial optimization problems with heterophily.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Graph Neural Networks (GNNs) are widely used to address combinatorial optimization problems. However, many popular GNNs struggle to generalize to heterophilic scenarios where adjacent nodes tend to be with different labels or dissimilar features, such as graph coloring problem. Moreover, most existing methods are typically optimized for specific instances and lack generalizability. To address these limitations, we propose an innovative self-supervised pre-training and fine-tuning framework HOCO for combinatorial optimization problems with heterophily. It adopts a heterophilic graph encoder to capture the heterophily through the separation of the node and its neighbors. Besides, bi-level optimization strategies are incorporated into our model: at the node level, contrastive learning helps to enhance representation discrimination of adjacent nodes; at the graph level, structural entropy optimization is used to refine the global clustering structure. Experimental results demonstrate that our model performs well on the graph coloring and maximum k-cut problems, significantly improving accuracy, generalization ability and computational efficiency compared to various baseline algorithms.

Authors

  • Xingyue Guo
    College of Computer Science, Nankai University, Tianjin, 300350, China. Electronic address: guoxingyue@dbis.nankai.edu.cn.
  • Pengfei Zhang
    Key Laboratory of Cardiovascular Remodeling and Function Research, Chinese Ministry of Education and Chinese National Health Commission, Department of Cardiology, Qilu Hospital of Shandong University. N0.107 Wenhuaxi Road, Jinan, Shanodng Province, China. Electronic address: pengf-zhang@163.com.
  • Qingqiong Cai
    College of Computer Science, Nankai University, Tianjin, 300350, China. Electronic address: caiqingqiong@nankai.edu.cn.
  • Ying Zhang
    Department of Nephrology, Nanchong Central Hospital Affiliated to North Sichuan Medical College, Nanchong, China.