arXiv AI By Haotian Qiao, Robert P. Dick

LLM-Driven, Datasheet-Aware Automated Hardware Compatibility Verification for Early-Stage, Pre-Schematic Embedded System Design

Read the original on arXiv AI →

The paper introduces an LLM‑driven, datasheet‑aware framework that performs early‑stage hardware compatibility verification for embedded systems. By building a design graph from datasheets and high‑level connectivity descriptions, it retrieves only the engineering properties needed for domain‑oriented verification criteria and generates deterministic scripts for evaluation. The approach decomposes compatibility analysis into modular stages, preserves intermediate results, and reduces context overhead, achieving 97.5% accuracy on seven designs while cutting input context size by 8.6× compared to traditional upload‑and‑query workflows.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 9

A Survey on LLM-Integrated Hardware Design Verification

The paper surveys how large language models (LLMs) are being used in hardware verification, covering tasks such as assertion generation, testbench creation, bug localization, and formal reasoning. It categorizes the literature by methodology, verification goal, tool interaction, benchmarks, and evaluation metrics, and distinguishes between inference-time techniques (prompting, retrieval, structured reasoning, agentic workflows) and training-time adaptation. The authors highlight that LLMs excel as semantic reasoning, search, and orchestration components within verification workflows, yet emphasize the need for semantic alignment, scalable integration, generalization, and rigorous evaluation to ensure true verification correctness.

By Hao Zheng, Jaime Rafael Imperial, Bardia Nadimi, Xiangfei Kong
arXiv AI
Oct 12

Faithful and Complete LLM-Assisted Automated Construction of Hierarchical Hardware Knowledge Graphs

The paper introduces an automated pipeline that uses large language models to convert hardware datasheets into hierarchical knowledge graphs. By chunking documents, routing extracted properties, and iteratively refining the graph, the method preserves source provenance and reduces context size per query. Evaluation on 20 datasheets shows a 98.8% property faithfulness and 83.6% coverage of baseline properties, outperforming a one‑shot baseline.

By Haotian Qiao, Robert P. Dick
arXiv Machine Learning
Sep 14

HoliBench: A Cross-Platform Benchmarking and Deployment Toolkit for Foundation Models in CPS-IoT Applications

HoliBench is a modular benchmarking and deployment toolkit that jointly measures accuracy, latency, and energy for foundation models across a wide range of devices, from single-board computers to GPU servers. It provides a platform abstraction layer that calibrates cross-device measurements and supports multiple model modalities, inference engines, and quantization levels. Using HoliBench, the authors evaluated 20 models on 7 device types, revealing tradeoffs such as limited latency gains from quantization on low‑precision hardware and diminishing accuracy returns relative to energy consumption, while also showing that single-model profiles can predict multi-model pipeline performance within a few percent.

By Inesh Chakrabarti, Zejun Xiong, Pragya Sharma, Mani Srivastava