arXiv Machine Learning

Semantic Alignment of AI Models: Concept Collapse, Checkpoint Dynamics, and Cross-Lingual Transfer

arXiv:2608. 01585v1 Announce Type: cross Abstract: Language model benchmarking is a difficult task.

arXiv Machine Learning

Aug 3

Persistent Convolution: A Topological Framework for AI Alignment Testing and Semantic Space Characterization

arXiv:2607. 29008v1 Announce Type: cross Abstract: Modern opaque AI models prize performance over interpretability, which makes testing difficult.

By Tyler Ashoff, Jordan Rodu

rag multimodal safety

arXiv AI

Jun 16

Overcoming the Impedance Mismatch: A Theoretical Roadmap for Fusing Foundation Models and Knowledge Graphs

arXiv:2606. 15656v1 Announce Type: new Abstract: Modern artificial intelligence remains fundamentally divided between the continuous, probabilistic spaces of Foundation Models and the discrete, deterministic structures of Knowledge Graphs.

By Sahil Rajesh Dhayalkar

rag safety

arXiv AI

Aug 11

Counterfactual Benchmarking and Training for Factuality Consistency and Order-Robust Grounded Reasoning in LLMs over Heterogeneous Knowledge

arXiv:2608. 07838v1 Announce Type: new Abstract: Large language models (LLMs) have increasingly supported response generation grounded in user-provided knowledge spanning heterogeneous structures.

By Shibo Chu, Yuze Liu, Tiehua Zhang, Zhishu Shen, Lianghua He, Haofen Wang, Zhijun Ding

llms fine-tuning benchmarks safety

arXiv AI

Aug 10

Geo-Spatial Concept Probing of Large Language Models: Abstraction, Compositionality, and Grounding

arXiv:2608. 07353v1 Announce Type: cross Abstract: Understanding concepts is fundamental to generalization.

By Karim Radouane, Jose G Moreno, Lynda Tamine

llms nlp benchmarks

arXiv AI

Aug 12

From Reasoning Depth to Reasoning Breadth: Evaluating Multi-Point Associative Reasoning in Large Language Models

arXiv:2608. 10444v1 Announce Type: cross Abstract: Large language models (LLMs) have made substantial progress on reasoning tasks that require increasingly long and complex inferential chains.

By Si'an Xie (Beijing University of Posts and Telecommunications), Jiaxun Liu (Peking University), Biao Yang (Kuaishou Technology), Wei Yuan (Kuaishou Technology), Fan Yang (Kuaishou Technology), Tingting Gao (Kuaishou Technology), Ming Wu (Beijing University of Posts and Telecommunications)

llms rag agents benchmarks

arXiv AI

Jul 21

Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective

arXiv:2607. 18026v1 Announce Type: new Abstract: Can large language models with substantially different parameter spaces be merged by direct weighted averaging, without training or semantic alignment?

By Jiahe Fan, Yinghao Hou, Si Chen, Aiyuan Zhang, Hong Xie, Defu Lian

llms efficiency benchmarks safety

arXiv Machine Learning

Aug 4

Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages

arXiv:2608. 00533v1 Announce Type: cross Abstract: Large Language Models have achieved substantial progress in reasoning capabilities.

By Sean Gip Lim, William Chandra Tjhi, Hai Leong Chieu

llms rag agents fine-tuning efficiency benchmarks safety

arXiv AI

Aug 11

Explaining, Verifying, and Aligning Semantic Hierarchies in Vision-Language Model Embeddings

arXiv:2603. 26798v2 Announce Type: replace-cross Abstract: Vision-language model (VLM) encoders such as CLIP enable strong retrieval and zero-shot classification in a shared image-text embedding space, yet the semantic organization of this space is rarely inspected.

By Gesina Schwalbe, Mert Keser, Moritz Bayerkuhnlein, Edgar Heinert, Annika M\"utze, Marvin Keller, Sparsh Tiwari, Georgii Mikriukov, Diedrich Wolter, Jae Hee Lee, Matthias Rottmann

llms rag multimodal safety

arXiv AI

Jul 28

Similarity All The Way Up: Multilingual Generalization in LLMs Relies on Language-Level Similarity Structures

arXiv:2607. 22699v1 Announce Type: new Abstract: As Large Language Models (LLMs) grow more capable across diverse tasks, their (in)ability to generalize remains difficult to quantify and poorly understood beyond limited domains.

By Supantho Rakshit, Adele Goldberg, Henry Conklin

llms benchmarks

arXiv AI

Jun 6

Harnessing Structural Context for Entity Alignment Foundation Models

arXiv:2606. 06109v1 Announce Type: cross Abstract: Entity alignment (EA) aims to identify equivalent entities across heterogeneous knowledge graphs (KGs) and is a key component of knowledge fusion and cross-KG reasoning.

By Xingyu Chen, Yuanning Cui, Zequn Sun, Wei Hu

benchmarks safety

arXiv AI

Jul 9

Comprehensive Evaluation of Large Language Model Responses: A Multi-Factor Scoring System

arXiv:2607. 06940v1 Announce Type: cross Abstract: The remarkable performance of large language models (LLMs) in linguistic tasks underscores an urgent need for comprehensive evaluation of their response quality.

By Yiming Gai, Junde Lu, Xuefei Huang

llms

arXiv Machine Learning

Jun 9

A Unifying Framework for Concept-Based Representational Similarity

arXiv:2606. 09653v1 Announce Type: new Abstract: Learned representations across models and modalities often exhibit striking structural similarities, suggesting shared underlying concept decompositions.

By Gr\'egoire Dhimo\"ila, Victor Boutin, Agustin Martin Picard, Thomas Fel, Thomas Serre

benchmarks safety

Related stories