Building Cost-Efficient Enterprise RAG applications with Intel Gaudi 2 and Intel Xeon

Faster assisted generation support for Intel Gaudi

RAG-Stack: Co-Optimizing RAG Serving Performance and Quality

arXiv:2608. 03487v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG), which augments large language model (LLM) generation with information retrieved from databases, has become a widely used approach for knowledge-intensive applications.

Benchmarking Language Model Performance on 5th Gen Xeon at GCP

RAGMark: A Comprehensive Framework for Benchmarking Retrieval-Augmented Generation Systems

arXiv:2609.05760v1 Announce Type: cross Abstract: We present RAGMark, a modular benchmarking framework for advanced Retrieval-Augmented Generation (RAG) systems targeting small-scale multi-GPU enviro...

Text-Generation Pipeline on Intel® Gaudi® 2 AI Accelerator

Spyre-Accelerated Retrieval-Augmented Generation on IBM LinuxONE: A Cloud-Native Architecture for Secure, High-Throughput Enterprise AI Inference

arXiv:2608.21393v1 Announce Type: new Abstract: Running large language models inside enterprise environments has always bumped up against a practical wall: the data lives in one place, the AI horsepo...