Building Cost-Efficient Enterprise RAG applications with Intel Gaudi 2 and Intel Xeon

Faster assisted generation support for Intel Gaudi

RAG-Stack: Co-Optimizing RAG Serving Performance and Quality

arXiv:2608. 03487v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG), which augments large language model (LLM) generation with information retrieved from databases, has become a widely used approach for knowledge-intensive applications.

Benchmarking Language Model Performance on 5th Gen Xeon at GCP

Text-Generation Pipeline on Intel® Gaudi® 2 AI Accelerator

Optimize and deploy with Optimum-Intel and OpenVINO GenAI

DumpsterCluster: From Dumpster Diving to Serving LLaMA-70B on $60 GPUs

arXiv:2608. 14614v1 Announce Type: cross Abstract: As AI datacenters retire functional GPUs, vast quantities of still capable accelerators enter secondary markets.