The paper introduces a new entity alignment foundation model that overcomes the limitations of existing models by addressing the "reasoning horizon gap". It employs a parallel encoding strategy that uses seed entity pairs as local anchors to guide message passing, thereby shortening inference paths and improving alignment across sparse, heterogeneous knowledge graphs. The model also incorporates a merged relation graph and a learnable interaction module, and experimental results demonstrate its strong generalizability to unseen knowledge graphs.
By Yuanning Cui, Zequn Sun, Wei Hu, Kexuan Xin, Zhangjie Fu
arXiv:2511. 07457v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated remarkable capabilities in modeling sequential textual data and generalizing across diverse tasks.
By Jiarui Feng, Donghong Cai, Yixin Chen, Muhan Zhang
arXiv:2606. 05382v1 Announce Type: new Abstract: Multi-table question answering requires models to retrieve relevant evidence, link schemas, and perform compositional reasoning across relational tables.
By Ankit Pratap Singh, Xin Su, Phillip Howard
K2-V2 is a fully open, 360‑open large language model built from scratch, designed to serve as a superior base for reasoning adaptation while also supporting conversation and knowledge retrieval. It competes with leading open‑weight models in its size class, outperforming Qwen2.5‑72B and approaching Qwen3‑235B, and incorporates domain knowledge, reasoning, long‑context handling, and tool use throughout training. The authors release the complete training history, data composition, model weights, and LLM360 artifacts to enable community use and continuous training.
By K2 Team, Zhengzhong Liu, Liping Tang, Linghao Jin, Haonan Li, Nikhil Ranjan, Desai Fan, Shaurya Rohatgi, Richard Fan, Omkar Pangarkar, Huijuan Wang, Zhoujun Cheng, Suqi Sun, Seungwook Han, Bowen Tan, Gurpreet Gosal, Xudong Han, Varad Pimpalkhute, Shibo Hao, Ming Shan Hee, Joel Hestness, Haolong Jia, Liqun Ma, Aaryamonvikram Singh, Daria Soboleva, Natalia Vassilieva, Renxi Wang, Yingquan Wu, Yuekai Sun, Taylor Killian, Alexander Moreno, John Maggs, Hector Ren, Guowei He, Hongyi Wang, Xuezhe Ma, Yuqi Wang, Mikhail Yurochkin, Eric P. Xing
The paper introduces a unified framework for aligning biomedical text with knowledge graphs using a lightweight projection learned via contrastive learning, keeping the text encoder and KG embedding model frozen. It evaluates six design choices—text encoder, KG embedding, projection head, triple composition, training direction, and hard‑negative sampling—on a newly created CTD‑Align corpus of 22K chemical‑gene interaction pairs linked to PubMed passages. The study finds that triple composition and training direction have the largest impact, while simpler linear projections over concatenated subject, predicate, and object embeddings yield the best performance.
By Artem Bisliouk, Elizaveta Nosova, Heiko Paulheim, Andreea Iana, Rita T. Sousa
The paper introduces Prototype-Mediated Process Supervision (PMPS), a method that uses learnable reasoning prototypes to provide structural supervision for latent chain-of-thought embeddings, addressing representation collapse and uneven information distribution. PMPS aligns latent and explicit CoT embeddings in a shared prototype space via many-to-many soft assignment and employs a Progressive Sequential Alignment module to guide training from positional priors to adaptive matching. Experiments show PMPS reduces output token length to under 50% of explicit CoT on GSM8K-Aug and improves accuracy by 2.08% over SIM-CoT, even surpassing CoT-SFT on GPT-2 and achieving the highest accuracy among latent reasoning methods on larger models and harder tasks.
By Yiqi Li, Xu Chen, Chen Ju, Jiangchao Yao, Zhaoyang Li, Jinsong Lan, Xiaoyong Zhu, Bo Zheng, Yu Wang