arXiv AI By Mustafa Serta\c{c} T\"urkel, Fatma Nur Korkmaz, Ahmet Tu\u{g}rul Bayrak

Comparing Chunking and Embedding Strategies for Turkish RAG Systems

Read the original on arXiv AI →

The study investigates how document segmentation (chunking) and embedding choices influence Retrieval-Augmented Generation (RAG) performance for Turkish, a morphologically rich language. Using a fully crossed experimental design, the authors compare three chunking strategies (fixed-length, semantic, and layout-aware Docling), five embedding models, and two large language model generators across three documents with different layouts, generating 9,000 graded question-answer evaluations. Key findings include that layout-aware chunking reduces the impact of embedding choice, the top embedding models perform similarly, faster generators are not more accurate, and the optimal configuration varies with content type, achieving a best overall accuracy of 87.0%.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Jul 2

Evaluating Chunking Strategies for Retrieval-Augmented Generation on Academic Texts

Retrieval-Augmented Generation (RAG) systems use the question-answering capabilities of Large Language Models (LLMs) to access information outside their parameters. We evaluate if cluster-based semantic chunking improves retrieval and answer quality compared to fixed-size and recursive chunking evaluating on long, structured academic theses using the Retrieval Augmented Generation Assessment (RAGAs) framework.

arXiv Computation and Language
Sep 14

EAR: Entity-Aware Partitioning Approach for Retrieval-Augmented Generation Development

The paper introduces EAR, an Entity‑Aware Partitioning approach that improves retrieval‑augmented generation for multiple‑choice question answering by extracting normalized surface anchors from questions, answers, and the corpus. EAR retrieves local windows around matching anchors and can attach a larger parent passage via an extractive summary, reducing retrieved words by 37.5‑40.2% compared to fixed‑size chunks. Experiments on a cleaned MMLU‑style subset with Mistral, Gemma, and DeepSeek show modest accuracy changes, none statistically significant, highlighting EAR’s methodological contribution of compact, inspectable retrieval units.

By Cenab Batu Bora, Oylum Alatl{\i}, Sebnem Bora, Oguz Dikenelli