Towards Data Science

How to Implement Structured Output with Local LLMs

Why use it? How to implement it?

Towards Data Science
Aug 20

How to Fine-Tune an LLM: An End-to-End Guide

The article "How to Fine-Tune an LLM: An End-to-End Guide" offers a practical, hands‑on walkthrough for fine‑tuning large language models in real‑world scenarios. It covers the entire process from data preparation to deployment, providing readers with actionable steps to adapt LLMs to specific tasks. The guide is aimed at practitioners looking to implement fine‑tuning in a structured, end‑to‑end manner.

By Sam Black
Towards Data Science
Aug 31

Your LLM Can Return Perfect JSON and Still Be Wrong

The article discusses insights gained from a deeper examination of Structured Outputs when dealing with messy, incomplete data. It highlights that even when a large language model returns perfectly formatted JSON, the content can still be incorrect. The author reflects on the implications of this observation for data science practices.

By Benjamin Nweke
Simon Willison
Sep 2

llm 0.34

The release of llm 0.34 introduces a new feature that enhances log output by including response duration in both milliseconds and a human‑readable format. The short log view now contains a dedicated duration_ms field. Additionally, the update incorporates multiple bug fixes and a notable performance boost to llm logs, attributed to waveplate integration.

Towards Data Science
Jul 24

Loop Engineering for RAG Generation: An LLM Cascade from a Cheap Local Model Up to a Hosted Flagship

Enterprise Document Intelligence [Vol. 1 #8quater] - Two angles on the cascade, cost and a validation loop, backed by a real sweep of twenty local models against a hosted flagship The post Loop Engineering for RAG Generation: An LLM Cascade from a Cheap Local Model Up to a Hosted Flagship appeared first on Towards Data Science .

By Kezhan Shi
Towards Data Science
Sep 24

When the Correct Answer Is Nothing, What Does Your Pipeline Return?

The article discusses how the reliability mechanisms added to large language model (LLM) pipelines can lead to confident but incorrect outputs, especially when the correct answer is absent. It examines the behavior of pipelines in such scenarios and highlights the paradox where safeguards intended to improve accuracy may actually reinforce errors. The piece underscores the importance of understanding pipeline responses when faced with missing or ambiguous information.

By Hubert García Gordon
Towards Data Science
5d ago

How to Make Your Own JEV Model from an Open LLM

The article explains how to transform a small open‑source Qwen LLM into a fast, single‑pass text classifier by replacing its language‑modeling head with a JEV model. It provides a step‑by‑step guide to swapping the head, enabling the LLM to perform classification tasks efficiently. The process leverages the flexibility of open‑source models to create a lightweight, high‑performance classifier.

By Anubhab Banerjee