arXiv AI
Sep 16

AquiLLM: Evaluating Faithfulness in Open-Weight RAG-LLM Systems for Scientific Research

arXiv:2609.16519v1 Announce Type: new Abstract: Scientific research increasingly relies on large, heterogeneous data sources, motivating interest in retrieval-augmented generation (RAG) systems that...

By Bernie Boscoe, Srinath Saikrishnan, Vikram Seenivasan, Jack Stark, Andrew Lizarraga, Morgan Himes, Jonathan Soriano, PJ Allen, Tuan Do
arXiv AI
Sep 2

EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models

The paper introduces EGT-KG, an evidence‑grounded typed knowledge graph retrieval framework designed to enhance scientific question answering with small language models (SLMs). It compares three QA settings—standard Retrieval‑Augmented Generation (RAG) and two EGT‑KG variants (automatically generated and expert‑defined relation schemas)—using a six‑dimensional evaluation on a biopolymer‑bound soil composite literature benchmark. Results show that both EGT‑KG variants outperform vanilla RAG, with the llama3:8b model achieving a final score of 70.37 (+14.67%) and 68.82 (+12.14%) for the AS and ES variants, respectively.

By Muran Yu, Jiechao Gao, Yuandong Pan, Barney H. Miao, Andrew C. Lesh, Kincho H. Law, Jie Wang, Michael D. Lepech