← Back to Computation and Language
cs.CL

Teaching language models to understand hypergraphs natively

Mengqi Lei, Guohuan Xie, Shihui Ying, Shaoyi Du, Jun-Hai Yong, Siqi Li, Yue Gao

May 21, 2026

Most work feeding relational structures into LLMs converts them to simple pairwise graphs, losing the semantics of higher-order relationships where multiple objects connect simultaneously—like a paper written by three authors or a chemical reaction with multiple reactants. Hyper-Align converts hypergraph structures directly into tokens using a hybrid template that preserves both local connection details and global patterns, then feeds these alongside text prompts into frozen LLMs. The approach outperforms existing methods on both in-domain and zero-shot hypergraph reasoning tasks, with a new benchmark (HyperAlign-Bench) for systematic evaluation.
Published as Hypergraph as Language arXiv:2605.21858
Read the original paper →