arXiv AI

Detecting Soft Errors in Parallel Software with LLM-tuned Instruction Duplication

The paper introduces PaRID, a software-directed soft error detection framework that uses parallel instruction duplication and LLM-tuned performance modeling. PaRID is designed to work at compile time for multithreaded programs, handling mixed serial and parallel regions while keeping performance overhead low. Experiments on NPB benchmarks show that PaRID cuts protection overhead from 162.79% to 59.84% on average and can achieve up to a 5× speedup while still detecting all errors.

arXiv AI
Jul 7

MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems

arXiv:2605. 28732v2 Announce Type: replace-cross Abstract: Memory is essential for enabling large language models to support long-horizon reasoning, yet existing memory systems remain unreliable and difficult to debug.

By Xinle Deng, Ruobin Zhong, Hujin Peng, Xiaoben Lu, Yanzhe Wu, Guang Li, Buqiang Xu, Yunzhi Yao, Jizhan Fang, Haoliang Cao, Junjie Guo, Yuan Yuan, Ziqing Ma, Yuanqiang Yu, Rui Hu, Baohua Dong, Hangcheng Zhu, Ningyu Zhang
arXiv AI
Oct 2

Are AI Coders Snitches? An Empirical Study of Pretraining Data Detection on Code Large Language Models

The paper investigates whether code large language models (CodeLLMs) inadvertently reproduce proprietary or sensitive code by evaluating seven state‑of‑the‑art training data detection (TDD) methods on eight CodeLLMs. It introduces CodeSnitch, a benchmark of 9,000 function‑level code samples across three languages, each labeled as included or excluded from training data, and applies mutation strategies based on the Type‑1 to Type‑4 code clone taxonomy to test TDD robustness. The study offers a systematic assessment of current TDD techniques for code and suggests directions for developing more effective detection methods.

By Tianlin Li, Yunxiang Wei, Zhiming Li, Aishan Liu, Qing Guo, Xianglong Liu, Dongning Sun, Yang Liu
arXiv AI
Oct 1

Trustworthy Runtime Error Healing in Real-World Repositories: A Benchmark and Guardrail

The paper introduces HealBench, a benchmark of 265 runtime errors from 18 real-world repositories, and HealGuard, a safety framework that restricts healing code to an analyzable subset of Python and applies static and dynamic taint analysis. Using these tools, the authors evaluate a dedicated healing method and three general coding agents powered by different LLM backbones, achieving a 38.11% resume rate and a 28.68% test‑pass rate, while HealGuard flags 17.4% of successful healings as potentially unsafe. The study demonstrates that current LLM agents can meaningfully repair real repository crashes, but also highlights significant safety concerns that the Guardrail framework can detect, albeit with a high false‑positive rate.

By Gou Tan, Pengfei Chen, Zhensu Sun, Jieke Shi, Junkai Chen, Ting Zhang, Weifeng Sun, Junda He, Shuai Liang, Chuanfu Zhang, Lwin Khin Shar, David Lo
arXiv Computation and Language
Oct 21

Self-Decomposing Diffusion for Code Generation

Self-Decomposing Diffusion for Code (SDDC) is a new diffusion language model framework that first generates a contract outlining program decomposition and inter‑unit dependencies, then uses this contract to guide coordinated parallel implementation of complex programs. By planning decomposition before generation, SDDC balances the trade‑off between aggressive parallel decoding and maintaining program correctness. Across five benchmarks and two 7B diffusion backbones, SDDC improves pass@1 by up to 31.1 percentage points while decoding 7.5–13.7× faster than base models, and outperforms a fine‑tuning baseline by up to 23.5 points with lower latency.

By Lize Shao, Zichen Xie, Zhizhen Chen, Zhe Zeng, Wenxi Wang
arXiv AI
Jun 12

Structured Testbench Generation for LLM-Driven HDL Design and Verification-Oriented Data Curation

arXiv:2606. 12983v1 Announce Type: new Abstract: Automated testbench generation has become a critical bottleneck in large language model (LLM)-driven Register Transfer Level (RTL) workflows, where large numbers of candidate designs must be verified rapidly and reliably.

By En-Ming Huang, Yu-Hung Kao, Ren-Hao Deng, Wei-Po Hsin, Yao-Ting Hsieh, Cheng Liang, Hsiang-Yu Tsou, Mu-Chi Chen, Yu-Kai Hung, Shao-Chun Ho, Po-Hsuang Huang, Shih-Hao Hung, H. T. Kung
arXiv Machine Learning
Sep 17

CompileRover: Revolutionizing Virtual Machine Compiler Optimization with a Tri-Role LLM-Driven Framework

CompileRover is a new optimization framework for virtual machine compilers that uses a tri‑role LLM‑driven collaboration mechanism involving a referee, an advisor, and an operator. It tackles common issues such as redundant computations, inefficient loops, and suboptimal function implementations by applying control‑flow analysis, code‑structure transformations, and dynamic execution pattern recognition. Benchmark evaluations show that CompileRover consistently outperforms existing virtual machine compilers, reducing execution overhead, improving data‑flow consistency, and enhancing overall compiler performance.

By Mingqiao Mo, Yunlong Tan, Hao Zhang
arXiv Machine Learning
Oct 21

LLMs are Brittle to Simple Code Transformations: Introducing CETBench - A Benchmark for Code-Equivalence Checking

The paper introduces CETBench, a benchmark for assessing large language models (LLMs) on code-equivalence checking by generating program pairs through random code transformations. It demonstrates that even simple transformations significantly degrade LLM performance, especially in cross-lingual scenarios, and proposes a fine-tuning approach to improve results. The study provides detailed ablations on program difficulty and transformation types, offering insights into LLMs’ limited semantic understanding of code.

By Neeva Oza, Ishaan Govil, Parul Gupta, Dinesh Khandelwal, Dinesh Garg, Parag Singla