Hugging Face Trending Papers July 19, 2026

Grounded verification of chemical and materials reasoning: detection is the bottleneck

Read the original on Hugging Face Trending Papers →

Large language models confabulate chemical objects (molecular formulas, space groups, formation energies) in fluent reasoning traces, concentrated on long-tail entities where confidence is least trustworthy. Deterministic, database-grounded verification can catch and repair such errors without the coverage cost of blanket retrieval; the binding constraint, we find, is detection, not repair.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

llms

arXiv Machine Learning

Jul 21

Grounded verification of chemical and materials reasoning: detection is the bottleneck

arXiv:2607. 17417v1 Announce Type: new Abstract: Large language models confabulate chemical objects (molecular formulas, space groups, formation energies) in fluent reasoning traces, concentrated on long-tail entities where confidence is least trustworthy.

By Can Polat, Mustafa Kurban, Erchin Serpedin, Hasan Kurban

llms

arXiv AI

Jun 3

From Answers to States: Verifiable Process-Level Evaluation of Chemical Reasoning in Large Language Models

arXiv:2606. 03660v1 Announce Type: new Abstract: Large language models are increasingly used as chemistry assistants, yet most chemistry benchmarks still score only final answers.

By Hongyu Guo, Hao Li, He Cao, Gongbo Zhang, Li Yuan

llms benchmarks safety

arXiv Machine Learning

Jul 14

Silent Failures in Quantized LLM Reasoning: A Taxonomy-Based Analysis of Hollow Convergence and Failure Mode Shifts

arXiv:2607. 09999v1 Announce Type: cross Abstract: We show that post-training quantization can silently alter how large language models reason even when task accuracy is preserved.

By Renuka Oladri, Mohan Vamsi Varadaraju Priya, Jerry Wu

llms efficiency benchmarks

arXiv AI

Jun 29

CalBrief: A Pilot Diagnostic Benchmark for Evidence-Calibrated Scientific Briefing with Large Language Models

arXiv:2606. 27383v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as research assistants, yet it remains unclear whether they can calibrate research takeaways to the strength and scope of the supporting evidence.

By Yu Fu, Yongqi Kang, Yong Zhao

llms benchmarks

arXiv AI

Jul 28

ConsistencyGate: Preventing Memory Contamination in LLM Agents via Self-Consistency Admission Control

arXiv:2607. 22962v1 Announce Type: new Abstract: LLM agents that operate over many turns accumulate facts in an external memory store and reuse them as premises for downstream reasoning.

By Yan Zhang, Shibo Li

llms agents fine-tuning benchmarks

arXiv AI

Jul 7

Evaluating LLM Uncertainty in Long-Form Generation Using Deterministic Ground Truth

arXiv:2607. 03870v1 Announce Type: new Abstract: As LLMs generate increasingly long outputs, effective uncertainty estimation must identify errors at fine-grained levels rather than discard entire responses.

By Ido Amit, Ido Galil, Ran El-Yaniv

llms benchmarks

Related stories

Grounded verification of chemical and materials reasoning: detection is the bottleneck

From Answers to States: Verifiable Process-Level Evaluation of Chemical Reasoning in Large Language Models

Silent Failures in Quantized LLM Reasoning: A Taxonomy-Based Analysis of Hollow Convergence and Failure Mode Shifts

CalBrief: A Pilot Diagnostic Benchmark for Evidence-Calibrated Scientific Briefing with Large Language Models

ConsistencyGate: Preventing Memory Contamination in LLM Agents via Self-Consistency Admission Control

Evaluating LLM Uncertainty in Long-Form Generation Using Deterministic Ground Truth