← Back to Computation and Language
cs.CL

Combining text and graph structure for knowledge graph predictions

Luu Huu Phuc, Ratan Bahadur Thapa, Mojtaba Nayyeri, Jingcheng Wu, Evgeny Kharlamov, Steffen Staab

May 18, 2026

Knowledge graph link prediction typically relies on either text descriptions alone or flattened entity neighborhoods, losing relational structure. GA-S2S integrates a T5-small encoder-decoder with a Relational Graph Attention Network (RGAT) to jointly encode both textual features and k-hop subgraph topology around query entities. The model captures multi-hop relational patterns that sequential linearization discards. On the CoDEx dataset, it outperforms competitive Seq2Seq baselines by up to 19% in link prediction accuracy.
Published as Leveraging Graph Structure in Seq2Seq Models for Knowledge Graph Link Prediction arXiv:2605.18211
Read the original paper →