arXiv Machine Learning By Aditi Patodiya

Broken on Arrival: Non-Functional Quantized LLM Artifacts in Public Model Registries and How to Catch Them

Read the original on arXiv Machine Learning →

The study examined 305 quantized large language models (LLMs) from public registries, testing them on a 15‑task code screen and 164 HumanEval+ tasks. Only seven low‑bit, small‑parameter models failed to solve more than six tasks, and none of the files were corrupted—reproducibility did not guarantee functionality. The authors released audit data and a tool, recommending pre‑publication screening and calibration of low‑bit tags.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language
Aug 31

Why Didn't It Check? Unsupported Final Claims and Their Repair in Two Tool-Equipped Language Models

The study investigates how language models equipped with tools can still produce unsupported final claims, even when a single tool call could resolve the uncertainty. It defines two metrics—occurrence (how often unsupported claims arise) and conditional repair (how often they are fixed when evidence is provided). Experiments on Qwen3-32B and Gemma 4 show that providing the missing evidence consistently repairs all unsupported claims in the Qwen3-32B setup, while the Gemma 4 model never produced unsupported claims under the tested conditions.

By Justin Bronder
arXiv AI
Aug 19

Probing the Prefill: Detecting Code Vulnerabilities via Latent Activations

The paper investigates whether the hidden activations of large language models (LLMs) contain signals about the vulnerability of C/C++ code when the code is provided as context. By extracting prefill token activations from four LLMs and training small MLP probes, the authors achieve an average F1 score of 41.7% across four benchmarks, with the best probe matching state‑of‑the‑art fine‑tuned classifiers on the Devign dataset. The results suggest that a coding LLM’s internal representation can inform vulnerability detection, opening the door to lightweight, model‑native screening methods.

By Alizishaan Khatri